-- Logs begin at Wed 2022-10-19 12:47:14 UTC, end at Wed 2022-10-19 14:06:20 UTC. -- Oct 19 13:25:59.390756 dv-cinder-861883-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 13:25:59.402072 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 13:25:59 2022] *** Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: nodename: dv-cinder-861883-1-iscsi Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: machine: x86_64 Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: clock source: unix Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: pcre jit disabled Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: detected number of CPU cores: 4 Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: current working directory: / Oct 19 13:25:59.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: detected binary path: /usr/bin/uwsgi-core Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: your processes number limit is 47680 Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: your memory page size is 4096 bytes Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: detected max file descriptor number: 2048 Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: lock engine: pthread robust mutexes Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: thunder lock: enabled Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 13:25:59.405428 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 13:25:59.443828 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: Python main interpreter initialized at 0x558f290df9c0 Oct 19 13:25:59.443828 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: python threads support enabled Oct 19 13:25:59.443828 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: your server socket listen backlog is limited to 100 connections Oct 19 13:25:59.443828 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: your mercy for graceful operations on workers is 90 seconds Oct 19 13:25:59.444155 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 13:25:59.444234 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: *** Operational MODE: preforking *** Oct 19 13:25:59.444483 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: *** uWSGI is running in multiple interpreter mode *** Oct 19 13:25:59.444483 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: spawned uWSGI master process (pid: 104253) Oct 19 13:25:59.444666 dv-cinder-861883-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 13:25:59.445782 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: spawned uWSGI worker 1 (pid: 104254, cores: 1) Oct 19 13:25:59.445782 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: spawned uWSGI worker 2 (pid: 104255, cores: 1) Oct 19 13:25:59.445782 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 13:26:00.099830 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:26:00.100423 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:26:01.172480 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:26:01.172480 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: from cryptography.utils import int_from_bytes Oct 19 13:26:01.173076 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:26:01.173076 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: from cryptography.utils import int_from_bytes Oct 19 13:26:01.175475 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:26:01.175475 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: from cryptography.utils import int_from_bytes Oct 19 13:26:01.175926 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:26:01.175926 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: from cryptography.utils import int_from_bytes Oct 19 13:26:03.626756 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:26:03.627349 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:26:03.627514 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:26:03.627624 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:26:03.627981 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:26:03.628095 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:26:03.628207 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:26:03.628372 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:26:03.628484 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.628733 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:26:03.628832 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.628989 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:26:03.629080 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.629906 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630007 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630231 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630330 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630653 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630881 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.630972 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631196 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631285 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631506 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631611 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631768 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.631857 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632079 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632178 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632450 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632547 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861883-1-iscsi {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632711 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.632862 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633026 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633174 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633352 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861883-1-iscsi {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633483 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633675 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633801 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.633983 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634142 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634297 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634395 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634642 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634735 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.634950 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.635207 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.635333 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.635568 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.635689 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.635970 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636095 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636229 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636373 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636551 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636668 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636881 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.636987 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637170 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637297 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637484 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637610 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637794 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.637918 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638112 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638237 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638419 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638565 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638831 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861883-1-iscsi {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.638965 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639146 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639236 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639455 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639547 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861883-1-iscsi {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639763 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.639858 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640170 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640316 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640478 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640590 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640782 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.640878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641100 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641199 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641421 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641525 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641726 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.641871 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642050 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642139 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642364 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642461 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642712 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.642828 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643030 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643123 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643329 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643425 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643634 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643724 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.643939 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.644027 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.644252 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.644351 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.644550 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.644638 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.645392 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.645499 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.645643 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.645742 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.645948 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646060 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646246 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646346 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646574 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646679 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.646915 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647061 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647164 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647247 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647384 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647539 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647706 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.647797 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648023 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648112 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648329 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648420 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648634 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648730 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.648937 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649026 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649239 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649336 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649542 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649639 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.649842 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650014 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650141 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650230 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650441 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650569 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650771 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.650874 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651079 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651177 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651395 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651541 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651699 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.651799 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652016 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652116 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652321 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652409 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652644 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652744 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.652944 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653033 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653277 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653368 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653584 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653689 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653886 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.653974 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654203 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654300 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654529 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654622 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654843 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.654944 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655147 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655237 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655449 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655547 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655755 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.655852 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656063 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656151 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656380 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656480 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656628 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656725 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.656924 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657012 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657224 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657326 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657526 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657614 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657830 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.657929 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658131 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658218 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658433 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658542 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658759 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.658860 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659062 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659150 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659361 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659447 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659661 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659760 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.659963 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660051 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660265 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660352 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660591 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660695 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.660909 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661044 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661199 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661305 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661523 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661636 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661800 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.661899 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662100 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662196 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662405 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662523 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662734 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.662832 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663035 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663140 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663337 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663435 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663640 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663728 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.663947 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664045 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664245 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664341 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664547 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664635 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664855 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.664944 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665155 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665251 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665457 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665552 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665767 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.665854 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666067 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666155 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666370 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666463 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666702 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666799 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.666997 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667086 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667300 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667407 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667602 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667699 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667908 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.667998 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668208 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668303 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668507 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668595 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668812 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.668923 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669108 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669197 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669407 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669516 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669704 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.669795 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670004 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670094 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670300 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670407 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670619 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670713 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.670921 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671009 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671240 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671347 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671541 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671629 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671843 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.671932 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.672149 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.672246 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.672455 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.672544 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.672777 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:26:03.672873 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673111 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673201 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673421 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673516 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673751 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.673841 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674078 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674168 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674393 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674481 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674727 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.674819 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675037 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675135 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675353 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675440 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675657 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675754 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.675962 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676064 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676293 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676390 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676602 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676769 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.676914 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677030 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677245 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677386 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677540 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677637 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677857 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.677947 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678168 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678257 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678473 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678608 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678841 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.678969 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679157 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679283 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679476 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679575 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679806 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.679896 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680132 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680232 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680445 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680544 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680780 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.680868 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681103 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681192 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681419 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681510 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681728 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.681820 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682036 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682125 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682342 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682433 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682675 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682781 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.682989 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683088 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683294 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683383 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683607 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683697 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.683914 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684003 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684235 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684326 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684544 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684633 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684850 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.684939 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685158 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685249 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685467 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685556 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685770 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.685870 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686080 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686176 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686394 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686485 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686737 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.686843 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687051 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687147 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687360 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687502 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687677 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687776 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.687981 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688069 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688288 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688385 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688594 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688698 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688896 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.688999 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689198 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689291 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689499 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689599 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689803 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.689892 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690100 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690187 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690410 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690541 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690740 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.690832 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.691049 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.691144 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.691378 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.691470 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692193 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692295 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692500 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692599 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692806 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.692898 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693114 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693204 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693417 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693516 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693723 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.693822 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694029 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694117 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694328 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694425 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694663 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694754 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.694968 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695066 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695271 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695379 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695589 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695686 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695891 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.695981 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696293 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696503 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696600 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696806 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.696895 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697112 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697210 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697421 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697549 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697726 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.697815 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698038 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698135 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698350 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698438 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698682 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698774 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.698997 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.699095 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.699587 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.699692 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.699900 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.699988 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700223 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700323 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700546 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700636 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700861 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.700960 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701164 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701255 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701469 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701558 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.701895 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702069 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702159 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702370 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702462 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702698 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702802 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.702997 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703097 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703298 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703398 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703597 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703699 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703897 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.703987 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704198 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704293 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704504 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704595 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704805 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.704893 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705104 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705192 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705404 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705495 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705702 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.705796 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706003 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706105 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706310 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706401 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706678 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706781 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.706987 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.707084 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.707362 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.707958 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708204 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708303 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708514 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708613 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708827 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.708918 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709133 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709223 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709443 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709552 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709747 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.709845 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710055 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710144 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710369 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710468 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710702 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.710805 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711019 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711109 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711325 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711425 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711644 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711733 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.711957 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712046 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712283 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712383 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712594 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712692 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712908 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.712996 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713212 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713302 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713527 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713616 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713866 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.713953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714187 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714278 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714496 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714607 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714830 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.714919 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715139 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715233 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715448 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715537 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715757 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.715847 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716062 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716150 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716372 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716459 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716674 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716770 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.716990 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717087 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717293 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717381 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717610 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717708 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.717914 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718002 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718236 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718334 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718553 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718660 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718866 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.718956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719174 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719269 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719491 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719600 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719807 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.719896 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720115 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720204 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720433 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720533 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720743 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.720834 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721051 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721148 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721361 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721458 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721663 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721751 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.721966 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722055 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722272 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722371 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722602 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722692 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.722933 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723026 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723241 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723339 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723543 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723640 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.723857 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724016 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724160 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724249 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724460 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724551 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724760 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.724860 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725064 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725151 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725369 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725458 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725673 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725774 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.725992 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726082 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726302 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726398 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726625 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726730 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.726930 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727019 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727247 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727340 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727552 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727649 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727852 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.727940 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728159 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728247 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728459 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728557 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728764 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.728852 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729169 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729380 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729470 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729693 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.729792 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730007 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730096 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730313 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730412 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730645 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730736 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.730953 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731041 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731261 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731352 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731570 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731658 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731876 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.731973 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732184 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732273 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732492 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732582 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732797 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.732896 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733103 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733193 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733409 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733498 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733720 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.733816 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734020 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734107 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734328 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734426 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734657 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734763 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.734960 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735050 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735267 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735356 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735572 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735662 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.735884 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.736128 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.736217 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.736456 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.736748 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.736849 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737068 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737156 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737390 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737487 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737706 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.737809 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738033 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738123 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738355 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738453 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738708 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.738799 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739013 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739111 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739320 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739409 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739624 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739715 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.739927 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740018 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740235 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740345 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740534 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740625 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740836 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.740934 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741137 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741233 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741441 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741529 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741740 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.741844 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742039 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742129 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742338 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742436 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742661 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742754 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.742966 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743066 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743264 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743362 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743572 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743662 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743872 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.743963 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744181 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744284 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744484 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744572 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744783 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.744873 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745083 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745186 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745382 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745471 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745683 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745772 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.745991 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746082 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746325 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746413 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746654 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746745 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.746999 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747092 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747302 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747391 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747605 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747694 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.747925 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748017 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748232 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748320 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748533 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748634 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748832 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.748930 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749137 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749233 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749443 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749545 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749743 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.749833 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750048 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750177 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750352 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750450 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750679 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750768 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.750984 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751075 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751281 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751381 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751587 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751678 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751888 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.751977 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752197 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752296 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752498 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752594 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752799 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.752888 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753099 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753192 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753406 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753501 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753709 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.753796 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.754010 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.754635 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.754846 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.754937 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755148 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755238 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755457 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755548 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755756 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.755844 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756058 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756149 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756363 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756454 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756669 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756757 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.756971 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757068 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757275 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757365 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757585 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757683 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757890 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.757987 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758284 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758496 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758652 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758828 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.758931 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759135 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759224 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759428 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759518 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759733 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.759879 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760040 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760131 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760351 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760449 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760654 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760745 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.760959 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761048 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761261 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761374 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761556 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761701 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761855 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.761945 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762158 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762254 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762457 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762599 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762782 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.762881 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763080 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763170 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763380 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763478 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763683 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763789 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.763991 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764090 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764292 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764388 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764591 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764681 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764892 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.764996 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765191 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765280 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765496 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765584 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765802 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.765901 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766147 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766238 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766448 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766566 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766784 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.766884 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767100 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767189 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767406 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767499 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767714 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.767813 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768021 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768110 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768322 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768413 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768635 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768732 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.768943 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769033 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769254 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769341 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769561 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769651 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.769914 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.770570 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.770743 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.770834 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771055 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771147 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771363 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771454 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771678 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771766 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.771992 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772084 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772310 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772399 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772614 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772717 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.772923 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773016 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773230 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773327 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773536 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773635 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773845 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.773933 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774150 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774246 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774460 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774580 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774794 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.774885 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775101 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775189 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775409 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775508 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775718 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.775806 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776028 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776117 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776335 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776425 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776640 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776727 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.776941 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777036 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777247 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777344 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777553 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777680 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777855 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.777943 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778163 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778253 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778466 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778641 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778819 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.778932 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.779099 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.779187 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.779408 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.779716 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.779838 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780148 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780269 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780457 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780564 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780768 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.780871 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781077 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781176 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781383 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781471 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781691 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.781778 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782001 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782090 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782306 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782396 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782643 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.782747 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783052 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783148 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783361 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783450 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783673 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783770 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.783976 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784063 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784280 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784367 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784583 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784679 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784894 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.784984 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785196 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785290 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785527 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785627 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785834 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.785922 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786137 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786224 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786447 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786561 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786780 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.786869 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787106 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787216 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787527 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787616 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787837 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.787938 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.788141 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.788250 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.788559 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.788647 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.788872 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789024 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789183 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789338 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789484 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789624 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789810 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.789960 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790099 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790254 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790405 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790607 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790753 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.790951 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791046 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791136 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791374 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791472 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791701 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.791793 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792014 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792103 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792322 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792420 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792627 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792722 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.792951 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793041 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793259 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793422 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793577 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793666 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793902 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.793992 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.794294 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.794395 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.794637 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.794743 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.794956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795053 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795277 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795367 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795585 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795688 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795891 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.795980 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796198 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796288 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796500 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796588 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796806 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.796895 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797111 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797201 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797419 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797514 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797729 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.797826 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798039 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798138 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798344 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798433 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798676 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798770 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.798982 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799105 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799286 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799375 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799596 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799699 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799904 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.799995 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800219 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800351 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800534 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800633 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800850 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.800974 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.801672 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.801768 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.801991 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802090 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802297 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802385 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802623 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802717 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.802928 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803029 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803231 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803322 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803535 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803624 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803861 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.803951 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804174 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804264 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804496 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804587 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804822 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.804912 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805133 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805222 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805450 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805547 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805775 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.805871 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806094 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806194 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806402 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806520 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806747 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.806838 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807069 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807156 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807375 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807478 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807676 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807767 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.807978 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808066 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808277 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808578 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808680 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808881 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.808969 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809186 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809296 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809484 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809572 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809784 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.809874 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810085 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810188 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810390 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810480 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810718 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.810821 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811030 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811119 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811337 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811424 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811640 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811729 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.811944 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812035 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812247 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812336 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812552 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812650 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812894 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.812986 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813202 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813291 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813530 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813629 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813843 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.813934 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814162 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814259 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814477 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814643 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814816 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.814908 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815127 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815214 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815441 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815538 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815750 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.815837 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.816062 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.816150 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.816367 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.816465 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.816729 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.817333 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.817552 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.817640 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.817866 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.817966 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.818204 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.818381 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.818733 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.818827 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819048 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819140 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819366 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819466 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819677 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819774 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.819987 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820076 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820299 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820396 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820608 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820701 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.820917 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821016 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821227 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821325 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821530 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821628 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821843 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.821932 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822161 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822248 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822483 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822648 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822835 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.822926 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823146 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823234 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823441 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823531 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823756 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.823846 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.824068 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.824156 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.824648 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.824755 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.824984 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825073 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825290 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825389 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825604 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825694 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.825917 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826013 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826227 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826324 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826554 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826667 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826866 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.826964 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827177 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827276 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827483 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827571 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827793 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.827881 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828097 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828187 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828408 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828546 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828714 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.828804 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829025 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829354 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829444 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829668 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829756 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.829979 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830070 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830290 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830379 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830623 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830716 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.830940 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.831144 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.831462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.831553 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.831780 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.831882 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832107 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832195 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832457 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832547 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832772 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.832872 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833088 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833176 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833407 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833496 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833711 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.833813 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834017 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834107 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834326 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834423 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834656 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834747 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.834957 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835045 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835263 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835361 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835572 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835661 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835875 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.835963 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.836179 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.836267 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.836482 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.836571 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.836796 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837010 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837329 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837419 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837652 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837741 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.837976 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838064 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838297 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838393 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838639 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838733 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.838948 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839038 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839266 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839367 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839572 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839677 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839877 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.839967 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840187 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840285 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840492 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840581 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840796 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.840885 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841100 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841198 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841408 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841505 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841714 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.841818 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842017 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842115 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842323 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842415 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842645 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842735 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.842951 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843041 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843260 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843349 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843565 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843663 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843868 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.843958 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844173 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844261 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844477 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844568 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844780 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.844870 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845079 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845167 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845381 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845479 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845686 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.845854 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846009 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846095 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846277 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846377 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846601 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846696 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.846911 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847001 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847222 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847322 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847553 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847641 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847869 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.847964 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848209 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848309 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848516 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848816 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.848906 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849122 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849219 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849427 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849554 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849737 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.849826 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850043 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850131 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850349 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850438 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850682 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.850773 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851019 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851109 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851336 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851548 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851877 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.851968 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.852191 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.852288 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.852521 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.852608 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.852849 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853015 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853155 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853246 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853458 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853596 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853761 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.853860 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854067 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854163 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854375 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854463 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854711 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.854817 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855022 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855119 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855330 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855418 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855634 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855731 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.855942 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856031 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856246 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856334 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856554 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856643 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856857 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.856945 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857164 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857252 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857557 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857774 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.857863 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858083 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858172 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858388 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858485 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858722 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.858830 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859039 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859138 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859373 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859460 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859687 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859776 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.859998 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860097 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860311 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860399 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860617 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860705 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.860925 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861028 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861248 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861343 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861540 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861646 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861851 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.861947 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862166 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862264 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862476 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862607 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862802 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.862893 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.863112 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.863456 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.864292 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.864384 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.864612 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.864709 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.864932 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865028 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865243 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865347 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865556 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865645 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865877 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.865975 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866189 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866293 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866518 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866611 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866832 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.866920 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867150 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867255 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867483 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867583 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867808 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.867904 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868133 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868231 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868438 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868528 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868741 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.868841 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869043 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869135 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869347 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869436 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869658 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869795 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.869963 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870052 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870265 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870354 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870595 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870689 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870904 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.870996 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871204 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871293 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871505 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871604 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871809 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.871906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872107 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872194 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872410 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872508 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872710 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.872798 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873011 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873146 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873313 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873412 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873616 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873705 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873910 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.873998 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874213 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874322 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874547 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874640 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874839 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.874928 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875143 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875233 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875442 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875530 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875743 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.875869 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876041 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876130 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876343 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876431 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876676 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876808 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.876989 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877087 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877311 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877401 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877620 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877718 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.877932 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878021 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878235 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878323 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878573 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878682 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878896 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.878992 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.879257 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.879836 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880058 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880170 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880367 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880456 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880684 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880772 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.880993 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881094 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881302 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881393 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881611 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881707 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.881922 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882019 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882231 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882322 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882562 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882654 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882895 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.882986 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883199 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883297 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883516 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883606 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883830 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.883919 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884146 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884235 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884457 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884555 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884767 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.884857 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885074 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885170 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885389 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885487 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885697 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.885787 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886005 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886093 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886311 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886409 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886639 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886744 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.886951 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887048 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887256 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887357 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887563 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887653 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887870 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.887959 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888181 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888272 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888495 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888584 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888816 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.888913 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889224 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889435 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889524 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889755 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.889843 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890082 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890181 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890404 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890493 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890755 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.890857 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891085 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891174 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891396 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891495 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891705 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.891808 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.892007 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.892107 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.892247 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:26:03.892337 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:26:03.892543 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:26:04.044652 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Registered counter for database nova_api Oct 19 13:26:04.044803 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO dbcounter [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Registered counter for database nova_api Oct 19 13:26:04.065616 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.068835 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.072852 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.075742 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writer thread running {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.128606 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.context [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9b7359-86fa-48bf-ad7a-7001c78b7560(cell1) {{(pid=104255) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:26:04.131706 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.context [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9b7359-86fa-48bf-ad7a-7001c78b7560(cell1) {{(pid=104254) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:26:04.132919 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.133384 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.134951 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.135554 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.135680 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.136027 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.136148 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.137587 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.138041 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.138314 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.138783 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.140021 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Registered counter for database nova_cell0 Oct 19 13:26:04.140738 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_concurrency.lockutils [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.142740 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO dbcounter [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Registered counter for database nova_cell0 Oct 19 13:26:04.144042 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Registered counter for database nova_cell1 Oct 19 13:26:04.146704 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO dbcounter [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Registered counter for database nova_cell1 Oct 19 13:26:04.151379 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.152635 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.155380 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.157407 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.159091 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.160874 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.162385 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writer thread running {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.165176 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writer thread running {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.304678 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Registered counter for database nova_cell0 Oct 19 13:26:04.307719 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO dbcounter [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Registered counter for database nova_cell0 Oct 19 13:26:04.313603 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.317082 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:26:04.318306 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.321774 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writer thread running {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:26:04.727244 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:26:04.734446 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:26:04.744649 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: WARNING keystonemiddleware.auth_token [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:26:04.751822 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: WARNING keystonemiddleware.auth_token [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:26:05.075180 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:26:05.081168 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:26:05.087009 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f290df9c0 pid: 104255 (default app) Oct 19 13:26:05.089055 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:05.090231 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Oct 19 13:26:05.090679 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Wed Oct 19 13:26:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:05.092130 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: WARNING keystonemiddleware.auth_token [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:26:05.098091 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: WARNING keystonemiddleware.auth_token [None req-2bf03269-81f1-4329-8f7b-c4031532119e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:26:05.103349 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f290df9c0 pid: 104254 (default app) Oct 19 13:27:28.518987 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:28.520591 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Oct 19 13:27:28.520982 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:28.532674 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_api:SELECT=3 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:28.533815 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_cell0:SELECT=3 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:28.534552 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_cell1:SELECT=3 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:28.536954 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:29.400685 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-67dad722-8c66-4059-8fcd-2a8b72a8b4d8 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:29.432037 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-67dad722-8c66-4059-8fcd-2a8b72a8b4d8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904374 Oct 19 13:27:29.432797 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 13:27:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:32.059814 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:32.060816 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-04072b0e-4c44-48cb-9209-68f0b65bfc47 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 19 13:27:32.061529 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:32.537933 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-4d517dc3-ba31-4932-bfe7-91eac7e7367e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:32.639321 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-4d517dc3-ba31-4932-bfe7-91eac7e7367e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.571873 Oct 19 13:27:32.640611 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:32.653977 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:32.654805 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell0:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:32.656714 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell1:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:32.661148 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:32.865433 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-7ae51b12-c2bc-4044-bd03-e397ee9a1fc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:33.065102 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-7ae51b12-c2bc-4044-bd03-e397ee9a1fc3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.416392 Oct 19 13:27:33.065796 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 13:27:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:35.642884 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-4d517dc3-ba31-4932-bfe7-91eac7e7367e admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:35.644433 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-4d517dc3-ba31-4932-bfe7-91eac7e7367e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Oct 19 13:27:35.645006 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:36.301245 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9dd9a928-56d3-4fe1-9f13-42f24d850de4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "id": "d1", "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:36.424072 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9dd9a928-56d3-4fe1-9f13-42f24d850de4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.773062 Oct 19 13:27:36.428702 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:36.437889 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-b9f06414-d58f-4b11-a8f4-e768f0d2d5df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:36.554822 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-b9f06414-d58f-4b11-a8f4-e768f0d2d5df admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120827 Oct 19 13:27:36.573347 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 13:27:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:39.136664 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9dd9a928-56d3-4fe1-9f13-42f24d850de4 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:39.137741 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9dd9a928-56d3-4fe1-9f13-42f24d850de4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 19 13:27:39.138152 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:39.547545 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-0e2666e8-5427-4045-8a22-dd6d1bdd4eba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:39.623765 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-0e2666e8-5427-4045-8a22-dd6d1bdd4eba admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479030 Oct 19 13:27:39.624529 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:39.637298 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9ccc5939-078d-4a9a-accf-8372f97e3f35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:39.726248 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9ccc5939-078d-4a9a-accf-8372f97e3f35 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092781 Oct 19 13:27:39.726891 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 13:27:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:27:42.323576 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-0e2666e8-5427-4045-8a22-dd6d1bdd4eba admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:42.324825 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-0e2666e8-5427-4045-8a22-dd6d1bdd4eba admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Oct 19 13:27:42.325460 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:42.742021 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-152b12dc-e453-4c29-aeb3-c777543bb8e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:42.811937 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-152b12dc-e453-4c29-aeb3-c777543bb8e9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479904 Oct 19 13:27:42.812600 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:42.825361 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-c1ba5a28-743b-448d-93c6-4a10c1c2217d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:42.897273 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-c1ba5a28-743b-448d-93c6-4a10c1c2217d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075704 Oct 19 13:27:42.898367 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 13:27:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:45.544408 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-152b12dc-e453-4c29-aeb3-c777543bb8e9 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:45.545429 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-152b12dc-e453-4c29-aeb3-c777543bb8e9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 19 13:27:45.545838 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:45.984595 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:46.069700 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517390 Oct 19 13:27:46.070285 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:46.082940 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-8103888b-33dd-4c98-996f-6e2faa10c743 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:46.182158 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-8103888b-33dd-4c98-996f-6e2faa10c743 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103081 Oct 19 13:27:46.182720 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Wed Oct 19 13:27:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:48.769602 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:48.771273 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Oct 19 13:27:48.771682 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:49.186118 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-853f0095-434d-485b-b730-2713bf7e4c32 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:49.211376 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-853f0095-434d-485b-b730-2713bf7e4c32 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433149 Oct 19 13:27:49.211909 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 13:27:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:27:51.765211 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:51.766166 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-3a5023ea-d89f-4898-b790-3bbb51fa9a2f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 19 13:27:51.766598 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:52.159992 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-61db2a21-b7d3-4610-a6a1-014ab1c1b0ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:52.236289 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-61db2a21-b7d3-4610-a6a1-014ab1c1b0ab admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.463838 Oct 19 13:27:52.236833 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:52.248642 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-ad5d54ef-a3ce-44f6-a9ac-edfad38b8085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:52.318646 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-ad5d54ef-a3ce-44f6-a9ac-edfad38b8085 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073403 Oct 19 13:27:52.319242 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 13:27:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:54.939636 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-61db2a21-b7d3-4610-a6a1-014ab1c1b0ab admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:54.940636 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-61db2a21-b7d3-4610-a6a1-014ab1c1b0ab admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 19 13:27:54.941920 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:55.312783 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-01caa5d7-e1cf-4a2e-a41c-1fcde05f0ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:55.394248 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-01caa5d7-e1cf-4a2e-a41c-1fcde05f0ef1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446045 Oct 19 13:27:55.394790 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:27:55.407058 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-494294d5-4eab-4c73-bc1f-1016ed502dcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:55.518034 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-494294d5-4eab-4c73-bc1f-1016ed502dcc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114578 Oct 19 13:27:55.518661 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 13:27:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:27:58.183834 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-01caa5d7-e1cf-4a2e-a41c-1fcde05f0ef1 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:58.184975 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-01caa5d7-e1cf-4a2e-a41c-1fcde05f0ef1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Oct 19 13:27:58.185379 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:58.633972 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-db056ddd-810c-4ec5-9805-136175bbfb33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "swap": 0, "id": "3"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:58.713094 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-db056ddd-810c-4ec5-9805-136175bbfb33 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.521112 Oct 19 13:27:58.713645 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:27:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:27:58.725858 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-f0941de5-b6fc-4f45-a521-2b7663772826 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:27:58.730664 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:58.837843 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-f0941de5-b6fc-4f45-a521-2b7663772826 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115597 Oct 19 13:27:58.838928 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 13:27:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:28:01.462616 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-db056ddd-810c-4ec5-9805-136175bbfb33 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:01.467040 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-db056ddd-810c-4ec5-9805-136175bbfb33 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 19 13:28:01.467040 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:28:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:01.909932 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-c579e3a5-a8da-4fbc-9727-9db35f9a8dd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:01.998841 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-c579e3a5-a8da-4fbc-9727-9db35f9a8dd9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.528872 Oct 19 13:28:01.999803 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:28:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:28:02.012734 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-5170931f-c6d5-45e5-8446-098157c5db99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:02.089573 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-5170931f-c6d5-45e5-8446-098157c5db99 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080548 Oct 19 13:28:02.090163 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 13:28:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:28:04.717643 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-c579e3a5-a8da-4fbc-9727-9db35f9a8dd9 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:04.718697 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-c579e3a5-a8da-4fbc-9727-9db35f9a8dd9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 19 13:28:04.719108 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:05.162463 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:05.263000 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.536710 Oct 19 13:28:05.263660 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Wed Oct 19 13:28:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:28:05.276035 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-12114169-8533-49f8-b4f9-364c6595405e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:05.356997 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-12114169-8533-49f8-b4f9-364c6595405e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084522 Oct 19 13:28:05.357584 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Wed Oct 19 13:28:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:28:23.371864 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:23.372906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 19 13:28:23.373307 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:23.384205 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:23.757957 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-c17cbea3-fd8c-4aaa-b0c9-d6fab30b6d10 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:23.775996 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-c17cbea3-fd8c-4aaa-b0c9-d6fab30b6d10 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396192 Oct 19 13:28:23.776531 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 13:28:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:28:25.089527 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.090584 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-967555f7-84c5-4ada-9a00-fa37e08a9c17 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Oct 19 13:28:25.090977 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:25.618126 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-869734cc-6077-4fac-bf25-962bd60df6af admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.623415 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.wsgi [None req-869734cc-6077-4fac-bf25-962bd60df6af admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-869734cc-6077-4fac-bf25-962bd60df6af admin admin] Request method failure captured: Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept: application/json Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept-Encoding: gzip, deflate Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Connection: keep-alive Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Content-Length: 0 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Host: 10.222.0.39 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-System-Scope: None Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: User-Agent: python-novaclient Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Auth-Token: gAAAAABjT_t479I4WWgAGKJZnnc7hxRLIZLBcTG4rhF_a07PfBcx75qqc4ytDWDxo9Xkn3DEFpO0DtVHGjQqOxnvK54_SikFhhDYHITddJAScxO1U08Kx9jX26F44KnQ8JGSfaTwK9swrqfOgUg4HIOZCpH-gvZSNYuONBwWNaSl3oPAYD9tbp8 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Id: None Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Name: None Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Identity-Status: Confirmed Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Is-Admin-Project: True Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Id: default Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Name: Default Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Name: admin Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Role: member,admin,reader Oct 19 13:28:25.626615 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Roles: member,admin,reader Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant: admin Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Name: admin Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User: admin Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Id: default Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Name: Default Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Name: admin Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: method: > Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: exception: Flavor 42 could not be found. Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: action_args: {'id': '42'} Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:25.628375 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:25.630560 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.631953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-869734cc-6077-4fac-bf25-962bd60df6af admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:25.633243 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-869734cc-6077-4fac-bf25-962bd60df6af admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389937 Oct 19 13:28:25.633243 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:25.637955 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-ecb01f6f-e774-4ec1-a42b-e15d84d72b84 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.642181 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:25.661179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-ecb01f6f-e774-4ec1-a42b-e15d84d72b84 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026786 Oct 19 13:28:25.661703 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:28:25.672214 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-01179d05-4cec-4be6-9341-3f504714e3ec admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.694230 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-01179d05-4cec-4be6-9341-3f504714e3ec admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026482 Oct 19 13:28:25.694878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:28:25.704490 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-efa7eae9-39a7-4130-9aa3-70bef7018aaa admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.710340 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-efa7eae9-39a7-4130-9aa3-70bef7018aaa admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-efa7eae9-39a7-4130-9aa3-70bef7018aaa admin admin] Request method failure captured: Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Host: 10.222.0.39 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjT_t479I4WWgAGKJZnnc7hxRLIZLBcTG4rhF_a07PfBcx75qqc4ytDWDxo9Xkn3DEFpO0DtVHGjQqOxnvK54_SikFhhDYHITddJAScxO1U08Kx9jX26F44KnQ8JGSfaTwK9swrqfOgUg4HIOZCpH-gvZSNYuONBwWNaSl3oPAYD9tbp8 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 19 13:28:25.713576 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User: admin Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: method: > Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: exception: Flavor 42 could not be found. Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: action_args: {'id': '42'} Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:25.720194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:25.721694 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:25.722994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-efa7eae9-39a7-4130-9aa3-70bef7018aaa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:25.724295 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-efa7eae9-39a7-4130-9aa3-70bef7018aaa admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014076 Oct 19 13:28:25.724295 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:26.923207 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-01179d05-4cec-4be6-9341-3f504714e3ec admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:26.924752 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-01179d05-4cec-4be6-9341-3f504714e3ec admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 19 13:28:26.925153 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:27.440349 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-3d04f25a-2d77-498c-a970-38b7a89fe8d9 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:27.445355 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-3d04f25a-2d77-498c-a970-38b7a89fe8d9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-3d04f25a-2d77-498c-a970-38b7a89fe8d9 admin admin] Request method failure captured: Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Host: 10.222.0.39 Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjT_t6UGGqhSXrxlAA6LaUBCbKUGc0-sm2HePnpCqDH_bHPF90X8TPkHqITmrTLrq63xoFVFwnxeA-_y3JifmdltHf6NwTZBLY9xDen9A3KU1Nfexhft9IbOKv6Zj5bxVvaBUpFG8co-D5BVBNLFSvvhX060zJzS2fsZ3nWOY3u6Ew82s Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 19 13:28:27.447123 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User: admin Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: method: > Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: exception: Flavor 84 could not be found. Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: action_args: {'id': '84'} Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:27.448468 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:27.449462 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.450786 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-3d04f25a-2d77-498c-a970-38b7a89fe8d9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:27.452010 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-3d04f25a-2d77-498c-a970-38b7a89fe8d9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385987 Oct 19 13:28:27.452010 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 13:28:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:27.458805 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-f33dd3ff-c477-4458-9074-5a368d45bdd5 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:27.474112 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-f33dd3ff-c477-4458-9074-5a368d45bdd5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019353 Oct 19 13:28:27.474680 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:28:27.483768 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cb0fe610-d084-4d12-a304-5133b2d669d7 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:27.498638 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-cb0fe610-d084-4d12-a304-5133b2d669d7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018279 Oct 19 13:28:27.499153 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:28:27.515480 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-ec5c9d85-0330-4c18-84e6-168a92a3516c admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:27.520862 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.wsgi [None req-ec5c9d85-0330-4c18-84e6-168a92a3516c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-ec5c9d85-0330-4c18-84e6-168a92a3516c admin admin] Request method failure captured: Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept: application/json Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept-Encoding: gzip, deflate Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Connection: keep-alive Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Content-Length: 0 Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Host: 10.222.0.39 Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-System-Scope: None Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: User-Agent: python-novaclient Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Auth-Token: gAAAAABjT_t6UGGqhSXrxlAA6LaUBCbKUGc0-sm2HePnpCqDH_bHPF90X8TPkHqITmrTLrq63xoFVFwnxeA-_y3JifmdltHf6NwTZBLY9xDen9A3KU1Nfexhft9IbOKv6Zj5bxVvaBUpFG8co-D5BVBNLFSvvhX060zJzS2fsZ3nWOY3u6Ew82s Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Id: None Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Name: None Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Identity-Status: Confirmed Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Is-Admin-Project: True Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Id: default Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Name: Default Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Name: admin Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Role: member,admin,reader Oct 19 13:28:27.522358 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Roles: member,admin,reader Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant: admin Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Name: admin Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User: admin Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Id: default Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Name: Default Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Name: admin Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: method: > Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: exception: Flavor 84 could not be found. Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: action_args: {'id': '84'} Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:27.523953 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:27.524878 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:27.526072 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-ec5c9d85-0330-4c18-84e6-168a92a3516c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:27.527198 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-ec5c9d85-0330-4c18-84e6-168a92a3516c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011897 Oct 19 13:28:27.527198 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Wed Oct 19 13:28:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:28.735859 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cb0fe610-d084-4d12-a304-5133b2d669d7 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:28.738441 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-cb0fe610-d084-4d12-a304-5133b2d669d7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Oct 19 13:28:28.738441 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:29.253825 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3c5559c5-364d-43eb-b106-4a662840a2d9 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:29.259476 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.wsgi [None req-3c5559c5-364d-43eb-b106-4a662840a2d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3c5559c5-364d-43eb-b106-4a662840a2d9 admin admin] Request method failure captured: Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept: application/json Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Accept-Encoding: gzip, deflate Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Connection: keep-alive Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Content-Length: 0 Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Host: 10.222.0.39 Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Openstack-System-Scope: None Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: User-Agent: python-novaclient Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Auth-Token: gAAAAABjT_t8LhQCKcUl-0KWRJohjeCZYsDB3qosR1FGbks2Pdwuji_nNtu1FjWDHPgH3_p5FhFNM-UM2VYmMm9X24Gje8DglmExkvXMP18s4GIavplb5zTBZEkYYeURoVfPD9fdXbwSJ2ADz6dNHx7WrkQgSQYzp3-kjVO5VbREHVf_9X3w08o Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Id: None Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Domain-Name: None Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Identity-Status: Confirmed Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Is-Admin-Project: True Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Id: default Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Domain-Name: Default Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Project-Name: admin Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Role: member,admin,reader Oct 19 13:28:29.260956 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Roles: member,admin,reader Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant: admin Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-Tenant-Name: admin Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User: admin Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Id: default Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Domain-Name: Default Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: X-User-Name: admin Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: method: > Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: exception: Flavor 451 could not be found. Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: action_args: {'id': '451'} Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:29.262626 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:29.263785 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.265191 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-3c5559c5-364d-43eb-b106-4a662840a2d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:29.266451 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-3c5559c5-364d-43eb-b106-4a662840a2d9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388712 Oct 19 13:28:29.266451 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:28:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:29.272593 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-36a78fa1-3a62-41a3-aca8-100ec62e7b16 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:29.287096 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-36a78fa1-3a62-41a3-aca8-100ec62e7b16 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018078 Oct 19 13:28:29.287637 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:28:29.296778 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:29.311041 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017696 Oct 19 13:28:29.311559 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Wed Oct 19 13:28:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:28:29.320917 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b32d5a92-673b-4c48-b254-dcfea451d705 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:29.325931 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-b32d5a92-673b-4c48-b254-dcfea451d705 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b32d5a92-673b-4c48-b254-dcfea451d705 admin admin] Request method failure captured: Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Host: 10.222.0.39 Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjT_t8LhQCKcUl-0KWRJohjeCZYsDB3qosR1FGbks2Pdwuji_nNtu1FjWDHPgH3_p5FhFNM-UM2VYmMm9X24Gje8DglmExkvXMP18s4GIavplb5zTBZEkYYeURoVfPD9fdXbwSJ2ADz6dNHx7WrkQgSQYzp3-kjVO5VbREHVf_9X3w08o Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 19 13:28:29.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf3ff3a529704cf9a1e0bae3d4c303ad", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf3ff3a529704cf9a1e0bae3d4c303ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Id: cf3ff3a529704cf9a1e0bae3d4c303ad Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User: admin Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Id: 94146067898240bfb358cef661f9b970 Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: method: > Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: exception: Flavor 451 could not be found. Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: action_args: {'id': '451'} Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:28:29.328906 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:29.331179 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 19 13:28:29.332242 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b32d5a92-673b-4c48-b254-dcfea451d705 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:28:29.333244 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-b32d5a92-673b-4c48-b254-dcfea451d705 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011301 Oct 19 13:28:29.333244 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:28:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:30.550392 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:30.551434 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 19 13:28:30.551836 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:31.069391 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-8b6908bb-2b39-421f-bfdc-68c611baae0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:31.152071 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-8b6908bb-2b39-421f-bfdc-68c611baae0a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.461185 Oct 19 13:28:31.152612 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 13:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:28:32.364158 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:32.365179 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 19 13:28:32.365581 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:32.885654 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-031eb2d3-6913-43d2-8112-eb70fabbe00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:32.953756 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-031eb2d3-6913-43d2-8112-eb70fabbe00c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.448912 Oct 19 13:28:32.954299 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 13:28:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:28:34.165387 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:34.166385 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 19 13:28:34.166830 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:34.685182 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-e8522e60-60c5-4ad8-bcc6-3bc597ce1ad9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:34.763642 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-e8522e60-60c5-4ad8-bcc6-3bc597ce1ad9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.457640 Oct 19 13:28:34.764194 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 13:28:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:28:35.975296 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:35.976324 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 19 13:28:35.976716 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:36.491776 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-36fd1334-1760-4ce7-abce-920ed0d21543 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:28:36.609990 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-36fd1334-1760-4ce7-abce-920ed0d21543 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.497503 Oct 19 13:28:36.610549 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Wed Oct 19 13:28:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:28:37.815040 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:37.816051 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Oct 19 13:28:37.816450 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:38.333854 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-50c555f5-2f26-41c5-ad1a-1a403b07450c admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:38.354486 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-50c555f5-2f26-41c5-ad1a-1a403b07450c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400390 Oct 19 13:28:38.355042 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Wed Oct 19 13:28:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:29:34.793539 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:34.794471 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-2288038b-b1e0-4e0e-9270-02a070c0b9ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 19 13:29:34.794906 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Wed Oct 19 13:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:34.805389 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:35.185542 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9537ff1b-d4f3-464e-9385-ab3daf17c7c4 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.206295 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9537ff1b-d4f3-464e-9385-ab3daf17c7c4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405415 Oct 19 13:29:35.206860 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Wed Oct 19 13:29:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:29:35.228509 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_api:SELECT=14 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:35.232241 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-573f373c-4da0-442f-b74b-cb960b862b80 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.239397 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-573f373c-4da0-442f-b74b-cb960b862b80 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012282 Oct 19 13:29:35.244137 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Wed Oct 19 13:29:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:35.251671 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-4a4c6146-2cff-4903-8671-50b4affab044 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.258741 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-4a4c6146-2cff-4903-8671-50b4affab044 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011191 Oct 19 13:29:35.259253 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Wed Oct 19 13:29:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:35.271049 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.278313 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010875 Oct 19 13:29:35.278866 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Wed Oct 19 13:29:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:35.290154 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-79451a5c-c987-4323-95d8-0e186c898819 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.297273 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-79451a5c-c987-4323-95d8-0e186c898819 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010671 Oct 19 13:29:35.297783 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Wed Oct 19 13:29:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:44.668255 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:44.669275 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 19 13:32:44.669675 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:32:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:32:44.810875 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=6 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:44.970593 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:44.975379 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.975854 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.976281 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.976994 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.977439 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.977857 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.008472 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-d12098fc-0a65-4975-98a5-cb0f7830c03f admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198910 Oct 19 13:32:45.009040 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:32:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:32:46.090847 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:46.091854 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 19 13:32:46.092254 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:32:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:32:46.284939 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:46.288357 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.288833 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.289264 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.290003 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.290430 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.290875 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.310538 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-93463139-828d-4c9d-a09d-6bba7c129581 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077111 Oct 19 13:32:46.311276 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:32:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:32:57.801286 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:57.802290 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 19 13:32:57.802707 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:32:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:32:57.945295 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell0:SELECT=4 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:57.946094 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell1:SELECT=4 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:57.946736 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=8 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:57.995642 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:57.999015 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.999496 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.000444 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.001159 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.001601 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.002019 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.027761 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-1e07868e-a46c-41b1-9816-139b895833b0 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086776 Oct 19 13:32:58.028328 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:32:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:59.098226 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG nova.api.openstack.wsgi [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] Calling method '>' {{(pid=104254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:59.099288 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: INFO nova.api.openstack.requestlog [None req-31b00bf9-4898-46d6-903c-2edaa638d161 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 19 13:32:59.099683 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: [pid: 104254|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Wed Oct 19 13:32:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:32:59.289983 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:59.293369 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.293848 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.294313 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.295059 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.295510 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.295936 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.317208 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-08b3deba-58d4-4c37-a0d8-508d178b56a8 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079482 Oct 19 13:32:59.317748 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Wed Oct 19 13:32:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:33:57.892038 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: Wed Oct 19 13:33:57 2022 - graceful shutdown triggered... Oct 19 13:33:57.892169 dv-cinder-861883-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 13:33:57.893328 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: Gracefully killing worker 1 (pid: 104254)... Oct 19 13:33:57.893726 dv-cinder-861883-1-iscsi devstack@n-api.service[104255]: Gracefully killing worker 2 (pid: 104255)... Oct 19 13:33:58.020562 dv-cinder-861883-1-iscsi devstack@n-api.service[104254]: DEBUG dbcounter [-] [104254] Writing DB stats nova_api:SELECT=4 {{(pid=104254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:58.894173 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: worker 1 buried after 1 seconds Oct 19 13:33:58.894173 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: worker 2 buried after 1 seconds Oct 19 13:33:58.894173 dv-cinder-861883-1-iscsi devstack@n-api.service[104253]: goodbye to uWSGI. Oct 19 13:33:58.895783 dv-cinder-861883-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 19 13:33:58.896325 dv-cinder-861883-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 13:33:58.899026 dv-cinder-861883-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 13:33:58.915176 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 13:33:58 2022] *** Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: nodename: dv-cinder-861883-1-iscsi Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: machine: x86_64 Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: clock source: unix Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: pcre jit disabled Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: detected number of CPU cores: 4 Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: current working directory: / Oct 19 13:33:58.917107 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: detected binary path: /usr/bin/uwsgi-core Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: your processes number limit is 47680 Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: your memory page size is 4096 bytes Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: detected max file descriptor number: 2048 Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: lock engine: pthread robust mutexes Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: thunder lock: enabled Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 13:33:58.917985 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 13:33:58.957333 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: Python main interpreter initialized at 0x55ff40cad9c0 Oct 19 13:33:58.957333 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: python threads support enabled Oct 19 13:33:58.957333 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: your server socket listen backlog is limited to 100 connections Oct 19 13:33:58.957333 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: your mercy for graceful operations on workers is 90 seconds Oct 19 13:33:58.957850 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 13:33:58.957850 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: *** Operational MODE: preforking *** Oct 19 13:33:58.958009 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: *** uWSGI is running in multiple interpreter mode *** Oct 19 13:33:58.958009 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: spawned uWSGI master process (pid: 125735) Oct 19 13:33:58.958237 dv-cinder-861883-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 13:33:58.961555 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: spawned uWSGI worker 1 (pid: 125748, cores: 1) Oct 19 13:33:58.961555 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: spawned uWSGI worker 2 (pid: 125749, cores: 1) Oct 19 13:33:58.961905 dv-cinder-861883-1-iscsi devstack@n-api.service[125735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 13:33:59.620730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:33:59.629705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:34:00.772992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:34:00.772992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: from cryptography.utils import int_from_bytes Oct 19 13:34:00.773655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:34:00.773655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: from cryptography.utils import int_from_bytes Oct 19 13:34:00.792449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:34:00.792449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: from cryptography.utils import int_from_bytes Oct 19 13:34:00.793024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:34:00.793024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: from cryptography.utils import int_from_bytes Oct 19 13:34:03.196184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:34:03.196759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:34:03.197059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:34:03.197354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:34:03.197612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:34:03.198006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.198335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.198780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.199242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.199582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.199900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.200232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.200556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.200888 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.201151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.201469 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.201800 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861883-1-iscsi {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.202131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.202442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.202782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.203106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.204063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.204268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.204579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.205088 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.206538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.206538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.206538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.206538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.206871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.207139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.207452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.207765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.208096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.208431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.208667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:34:03.209087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861883-1-iscsi {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.209195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:34:03.209270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.209504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.209628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:34:03.209712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.209792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:34:03.210056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:34:03.210166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.210456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.210590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.210807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.211061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.211274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.211634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.211634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.212101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.212320 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.212537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.212743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.212966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.213173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.213394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.213610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.213796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.214927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861883-1-iscsi {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.215867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.216854 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.217945 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.218121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.218276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.218447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.218630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.218835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.219499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.219645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.219796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.219941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.220857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.221378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.221972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222768 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861883-1-iscsi {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.222924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.223877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.224983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225285 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.225892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.226867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227495 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227645 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.227931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.228942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.229859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.230974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.231343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.231496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232592 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.232898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233202 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.233974 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234135 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234809 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.234959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.235867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.236947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237842 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.237998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.238150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.238295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.238437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.238695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.238876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.239947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.240988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.241131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.241485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.241642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.242294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.242550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.242714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.242859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243747 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.243896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.244869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245317 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.245911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.246061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.246205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.246358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.246541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.246702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.246860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.247003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.247157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.247299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.247451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.247603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.247754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.247896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.248040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.248194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.248345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.248502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.248646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.248646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.248925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.248925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.249213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.249364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.249525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.249669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.249831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.249980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.250142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.250286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.250437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.250437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.250759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.250904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.251047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.251197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.251557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.251728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.251898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.252409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.252576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.252826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.252983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.253141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.253285 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.253436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.253579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.253759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.254013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.254177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.254330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.254602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.254757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.254903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.255069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.255224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.255378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.255529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.255678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.255830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.255986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.256130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.256273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.256415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.256558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.256785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.256970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.257126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.257279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.257423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.257624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.257774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.257916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.258072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.258223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.258366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:34:03.258535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.258696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.258840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259158 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.259917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260222 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260516 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260816 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.260968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.261119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.261270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.261413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.261767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.261928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.262081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.262681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.262837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263960 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.263960 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.264255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.264406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.264592 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.264742 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.264886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.265031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.265188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.265339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.265492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.266950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267692 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.267843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.270391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.270608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.270791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.270946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.271104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.271258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.271410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.271562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.271954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.272107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.272259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.272734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.272978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.273216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.273487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.273646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.273790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.273934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.274909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275514 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.275959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.276837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.277995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278784 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.278937 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279088 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.279857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280140 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.280899 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.281042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.281193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.281396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.282224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.282371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.282815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283239 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.283982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.284959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.285118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.285316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.286267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.286428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.286638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.286803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.286954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287300 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.287936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288549 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.288855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.289974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.290938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.291881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.292240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.292410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.292517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.292635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.292976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293659 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.293916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294462 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294730 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.294932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295842 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.295993 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.296831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.297991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.298951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299092 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299804 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.299949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300654 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.300943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.301982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302679 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.302837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303138 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303519 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303588 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303657 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303735 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.303932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304537 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.304988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305147 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305305 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305627 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.305947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.306028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.306261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.306349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.307668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.307668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.307912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308035 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.308962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.309948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.310969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.311924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.312075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.312244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.312648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.313731 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.313898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.313898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.314845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.315166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.315312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.315476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.315723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.315890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.316948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317715 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.317903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318215 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.318920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319077 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.319743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320521 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.320996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.321944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.322103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.322253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.322402 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.322769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.322940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.323101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.323277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.323632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.323924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.324952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.325156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.325320 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.325485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.325644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.325930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.326095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.326260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.326260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.326720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.327864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.328023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.328694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.328867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.329971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.330955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.331900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.332064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.332224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.332381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.332532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.332860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.333029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.333182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.333340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.333516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.333871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334657 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.334981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.335175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.335424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.335579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.335737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.335906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.336992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.337309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.337477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.337477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.337765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.337916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.338950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.339900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.340054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.340211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.340371 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.340524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.340875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.341889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.342041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.342204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.342365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.342559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.342559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.343002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.343197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.344710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.344879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.345859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.346017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.346170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.347251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.347569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.347725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.347879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.348853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.349851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.350959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351804 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.351965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.352906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.353228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.353381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.353533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.353684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.353835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.354024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.354333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.354550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.354945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.355957 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.356763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.357923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.358303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.358559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.358722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.358897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.359050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.359468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.359625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.359792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.359952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.360114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.360275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.360420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.360752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.360910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361062 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.361899 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362194 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.362954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363135 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.363934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.364075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.364256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.364486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.364641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.364802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365515 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.365964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.366910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367511 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.367997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368344 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.368879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.369914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370289 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.370860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.371971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.372958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.373919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.374927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375789 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.375970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376614 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.376970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377320 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.377925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378820 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.378918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379288 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379565 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.379942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380310 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.380857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.381790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382008 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.382997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.383936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.384886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.385953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.386938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.387050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.387160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.387440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.387757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.387900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.388863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.389954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.390048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.390262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.390354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.390600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.391259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.391505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.391843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.392165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.392363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.392539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.392709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.392853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.393995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.394985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.395929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.396918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.397182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.397292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.397566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.397788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.397948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.398888 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.399977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.400910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.401131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.401355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.401451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.401679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.402791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.403973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.404919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.405915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.406070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.406222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.406929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407326 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.407856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408522 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.408841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.409799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.410997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411616 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.411919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.412930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.413874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414178 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.414802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.415903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416507 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.416906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.417950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.418949 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419043 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.419990 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420828 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.420982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.421123 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.421370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.421528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.421732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.421895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.422086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.422321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.422467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.422784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.422897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.423885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.424793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425784 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.425950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426361 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426599 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.426919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427875 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.427977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.428894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.429826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.430793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431012 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.431947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.432979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433212 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.433931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434616 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.434924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.435959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.436129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.436346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.436441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.436688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.436793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437123 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.437829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.438045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.438139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.438693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.438803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.438974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.439950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440882 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.440977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.441907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442756 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.442853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443474 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443666 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.443968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.444974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.445884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.446817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447043 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.447784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448012 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.448954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449588 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.449889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.450926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.451861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.452812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.453036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.453637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.453854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.453956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454275 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.454944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.455874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456490 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.456819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.457943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458250 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.458905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459514 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.459951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.460852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.461826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.462960 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:34:03.463051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.463351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.463670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.464001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.464335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.464660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.464981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.465322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.465640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.465959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.466281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.466624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.466943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.467261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.467598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.467934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.468249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.468586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.469462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.469791 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.470116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.470438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.470804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.471124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.471445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.471763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.472082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.472402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.472727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.473045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.473363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.473688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.474009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.474343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.474705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.475023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.475357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.475691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.476049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.476368 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.476767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.477063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.477386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.477709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.478022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:34:03.478273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:34:03.524362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO dbcounter [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Registered counter for database nova_api Oct 19 13:34:03.540269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO dbcounter [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Registered counter for database nova_api Oct 19 13:34:03.545022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_db.sqlalchemy.engines [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.551714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writer thread running {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.560321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_db.sqlalchemy.engines [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.567817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writer thread running {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.607816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.context [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9b7359-86fa-48bf-ad7a-7001c78b7560(cell1) {{(pid=125748) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:34:03.611901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.612370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.613921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.614673 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.615160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.617257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.619273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO dbcounter [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Registered counter for database nova_cell0 Oct 19 13:34:03.623392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO dbcounter [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Registered counter for database nova_cell1 Oct 19 13:34:03.623520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.context [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b9b7359-86fa-48bf-ad7a-7001c78b7560(cell1) {{(pid=125749) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:34:03.628023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.628509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.630110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.630893 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.633381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_db.sqlalchemy.engines [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.633505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.633602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_db.sqlalchemy.engines [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.633692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.635496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO dbcounter [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Registered counter for database nova_cell0 Oct 19 13:34:03.639530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writer thread running {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.639658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO dbcounter [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Registered counter for database nova_cell1 Oct 19 13:34:03.641709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writer thread running {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.647651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_db.sqlalchemy.engines [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.651085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_db.sqlalchemy.engines [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.655574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writer thread running {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.661329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writer thread running {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.790291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO dbcounter [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Registered counter for database nova_cell0 Oct 19 13:34:03.797512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_db.sqlalchemy.engines [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.801778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writer thread running {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:03.805812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO dbcounter [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Registered counter for database nova_cell0 Oct 19 13:34:03.814409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_db.sqlalchemy.engines [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:34:03.818960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writer thread running {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:34:04.119381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: WARNING keystonemiddleware.auth_token [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:34:04.126943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: WARNING keystonemiddleware.auth_token [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:34:04.136146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: WARNING keystonemiddleware.auth_token [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:34:04.143981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: WARNING keystonemiddleware.auth_token [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:34:04.474099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: WARNING keystonemiddleware.auth_token [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:34:04.480071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: WARNING keystonemiddleware.auth_token [None req-228d223a-9b7d-47c0-ab3f-48c9cd69acdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:34:04.486103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff40cad9c0 pid: 125748 (default app) Oct 19 13:34:04.489956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: WARNING keystonemiddleware.auth_token [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:34:04.495867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: WARNING keystonemiddleware.auth_token [None req-5c22637e-5f41-4894-b293-01c0ed4b7e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:34:04.501192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff40cad9c0 pid: 125749 (default app) Oct 19 13:34:39.531296 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:39.532872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:39.533760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:39.534787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:40.799851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b737b087-7345-47f3-b0e3-e51a3b402ce9 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Action: 'create', calling method: .version_select at 0x7fb41f477b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1684609275"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:41.673418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:41.695532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:41.695532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:41.695532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:43.133639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fe0a237e-0c7f-432e-9a13-5b32b912b058 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Action: 'create', calling method: .version_select at 0x7fb41f476b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1876323644", "metadata": {"Type": "work"}}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:43.467391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b737b087-7345-47f3-b0e3-e51a3b402ce9 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.941639 Oct 19 13:34:43.468329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Oct 19 13:34:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3944 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 13:34:43.484421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b16d854e-8954-42da-a4fd-626b57142086 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f3509d0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:43.791904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b16d854e-8954-42da-a4fd-626b57142086 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.310578 Oct 19 13:34:43.791904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:43 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:44.805578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ed19ba66-286d-427e-9c26-ad010648cae8 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f2e20d0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:45.133561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ed19ba66-286d-427e-9c26-ad010648cae8 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.331039 Oct 19 13:34:45.142479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 3/3] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:44 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:45.214860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fe0a237e-0c7f-432e-9a13-5b32b912b058 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.557619 Oct 19 13:34:45.215488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 1/4] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 13:34:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3565 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 19 13:34:45.230353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f50055ab-2ad2-4b6b-81de-e9c3f9624835 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2e2790>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:45.341540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f50055ab-2ad2-4b6b-81de-e9c3f9624835 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.115191 Oct 19 13:34:45.343061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 4/5] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:45 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:46.149904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c428416f-7980-4586-8ed9-6364b378e88d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f34f9d0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:46.251323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c428416f-7980-4586-8ed9-6364b378e88d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 346 microversion: 2.1 time: 0.106077 Oct 19 13:34:46.252406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 2/6] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:46.266995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9303d29a-cf0a-46e7-9688-00689a215fc1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Action: 'create', calling method: .version_select at 0x7fb41f350af0>, body: {"snapshot": {"volume_id": "64abc60e-f5c0-490f-856b-a836ab54a1b8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-911303899"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:46.357172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-61e739bb-fccd-4f80-8fae-4e47c80ebe37 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2e6160>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:46.570057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-61e739bb-fccd-4f80-8fae-4e47c80ebe37 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 354 microversion: 2.1 time: 0.216937 Oct 19 13:34:46.580264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:46.585182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6b546228-6e6c-4375-85b7-393bef2569ba tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41f2e6820>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.209102 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9303d29a-cf0a-46e7-9688-00689a215fc1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.947491 Oct 19 13:34:47.210697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 5/8] 10.222.0.39 () {60 vars in 1162 bytes} [Wed Oct 19 13:34:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:47.231232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bcf1f5b9-53aa-469d-888c-d3bfd882ae42 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2e2c10>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.365922 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6b546228-6e6c-4375-85b7-393bef2569ba tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/44ba845d-df93-448b-9732-de3b5defacab" status: 200 len: 351 microversion: 2.1 time: 0.784278 Oct 19 13:34:47.367167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 4/9] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/os-volumes/44ba845d-df93-448b-9732-de3b5defacab => generated 351 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:47.372575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1ca1e840-3e48-4f22-a85a-d1460618cd63 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f34fb80>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.476627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bcf1f5b9-53aa-469d-888c-d3bfd882ae42 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 354 microversion: 2.1 time: 0.264756 Oct 19 13:34:47.477674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 6/10] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:47 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 354 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:47.529107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-030a3430-2b32-4f00-b9f8-e5008dbb14d4 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2f03a0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.868773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1ca1e840-3e48-4f22-a85a-d1460618cd63 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.495998 Oct 19 13:34:47.868773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 5/11] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:47 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:47.878905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-eb8aa02d-01a7-4ec8-a0af-1a02cb83e22c tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f2e6940>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:48.192364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-030a3430-2b32-4f00-b9f8-e5008dbb14d4 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 202 len: 0 microversion: 2.1 time: 0.689080 Oct 19 13:34:48.197456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:34:47 2022] DELETE /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:34:48.208009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2e983869-a2fd-4d4b-9b45-ae813e767a62 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2e2c10>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:48.499293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2e983869-a2fd-4d4b-9b45-ae813e767a62 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.300266 Oct 19 13:34:48.505487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-eb8aa02d-01a7-4ec8-a0af-1a02cb83e22c tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.631353 Oct 19 13:34:48.506102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 13:34:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:48.512827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:48 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:48.519280 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6a109697-7026-457d-b868-bda48f11d11b tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f2e2550>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:48.581676 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6a109697-7026-457d-b868-bda48f11d11b tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.066559 Oct 19 13:34:48.582459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 9/15] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:48 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:49.513184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c307648d-186b-452c-a4d3-8acb8f105c0d tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2f03a0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:49.631956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c307648d-186b-452c-a4d3-8acb8f105c0d tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.122356 Oct 19 13:34:49.633069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:49 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:49.640589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c565d73e-45e4-48a5-804e-c5de9000b84a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f2e6c10>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:49.703007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c565d73e-45e4-48a5-804e-c5de9000b84a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.068321 Oct 19 13:34:49.704498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:49 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:49.842929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-98858ec0-3623-4583-911b-725550b17e90 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: .version_select at 0x7fb41f350f70>, body: {"keypair": {"name": "tempest-keypair-852527850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeX+WHAvwD0v8wLz9hCwb5ixeoiE9dIN8h7/Jrd+ug/V3k1ACfMjvd4Z+BBK0Gqd59H2kyLz0c3Agc8Sgdwt6oZ/fx57Gm3v/xGcIuO1HkCof6HIOt1Rj+1AmRSdnsZfQ=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:49.922485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-98858ec0-3623-4583-911b-725550b17e90 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:34:49.936620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-98858ec0-3623-4583-911b-725550b17e90 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for user 6c828726ae814c0f879a5aa69f647a96 and project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:34:50.138129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-98858ec0-3623-4583-911b-725550b17e90 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.553426 Oct 19 13:34:50.140418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 10/18] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 13:34:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 558 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 13:34:50.650706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1a2d5633-a8b0-4b28-a2c8-8d2787a3ee00 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f2e6a60>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:50.722879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7ca19bd9-be8f-4f20-a734-097eb4d8ed7f tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f2c5f70>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:50.729037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1a2d5633-a8b0-4b28-a2c8-8d2787a3ee00 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.082785 Oct 19 13:34:50.729978 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 9/19] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:50 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:50.841179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7ca19bd9-be8f-4f20-a734-097eb4d8ed7f tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.122270 Oct 19 13:34:50.849893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 11/20] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:50 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:51.748127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-88f3b495-a889-4ab0-b02d-b0cf70ec9e91 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f34fe50>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:51.852485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-88f3b495-a889-4ab0-b02d-b0cf70ec9e91 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.112081 Oct 19 13:34:51.853554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 10/21] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:51 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:51.854393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-21f02a08-2280-45bf-a466-9d0290600d5a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f277670>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:51.979621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-21f02a08-2280-45bf-a466-9d0290600d5a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.130053 Oct 19 13:34:51.980858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 12/22] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:51 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:52.869234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2590fc40-e514-43c3-8390-4039992807b3 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f34fca0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:52.994365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-46a9ec1f-d076-401e-ac07-7c2046bfd6c1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41f277d30>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:52.996242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2590fc40-e514-43c3-8390-4039992807b3 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.131021 Oct 19 13:34:52.997126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:52 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:53.217058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-46a9ec1f-d076-401e-ac07-7c2046bfd6c1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.227775 Oct 19 13:34:53.218785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 13/24] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:52 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:54.018392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c89d48e0-1303-4188-a7b2-658b79d9ccf5 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41f277a60>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:54.069345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1200367550", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:54.215713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c89d48e0-1303-4188-a7b2-658b79d9ccf5 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 200 len: 353 microversion: 2.1 time: 0.208878 Oct 19 13:34:54.231187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 14/25] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:54 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:54.288699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] validate_networks() for [('ebe83939-e1a8-4db7-ba5f-97087a8d3d2e', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:34:54.338845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-599588348", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "networks": [{"uuid": "04242b63-eb9a-47e1-8dd7-d1cf4e9553e3"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:54.463923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] validate_networks() for [('04242b63-eb9a-47e1-8dd7-d1cf4e9553e3', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:34:55.349613 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:34:55.354365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:34:55.354365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:34:55.354365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:34:55.354365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:34:55.396204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.396698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.397138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.397861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.398313 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.400647 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.469880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:34:55.478744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for user 020ff888a8a44d2eb6961829407637a9 and project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:34:55.495048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:34:55.496158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:34:55.499391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:34:55.500711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:34:55.501328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:34:55.501884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:34:55.502499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:34:55.525089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.525646 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.526177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.527058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.527631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.528056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.569099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Getting quotas for project 1a49e667714043b9a821ac5c0b8b3663. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:34:55.573179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Getting quotas for user 8665d60741af4d96a3ceb8f59ff458bb and project 1a49e667714043b9a821ac5c0b8b3663. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:34:55.587733 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:34:55.590837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:34:55.646016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ee4584f1-d1d7-420e-b4cd-d6949414e9ad tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.908806 Oct 19 13:34:55.647047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 12/26] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:34:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:34:55.656802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c7d2785-ece0-4ad9-bf39-2a180f4db567 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e9fe700>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:55.777790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-34ee3ec9-8855-4ae6-96ec-24082288d429 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558453 Oct 19 13:34:55.779113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 15/27] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:34:55.786765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-327809488", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28483e85-4ae3-42e0-a207-82b7c0da6321"}], "security_groups": [{"name": "tempest-securitygroup--381240425"}], "key_name": "tempest-keypair-852527850", "user_data": "}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:55.961925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] validate_networks() for [('28483e85-4ae3-42e0-a207-82b7c0da6321', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:34:56.109996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0c7d2785-ece0-4ad9-bf39-2a180f4db567 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 287 microversion: 2.1 time: 0.461295 Oct 19 13:34:56.110812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 13/28] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:55 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 287 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:56.117541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d22b82c6-b303-49bd-816b-1b7fe2662353 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Calling method '.version_select at 0x7fb41e9fee50>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.239507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-d22b82c6-b303-49bd-816b-1b7fe2662353 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] HTTP exception thrown: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d22b82c6-b303-49bd-816b-1b7fe2662353 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Request method failure captured: Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 HTTP/1.1 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_zx9N2uGywPZjxlQtmxtq0iQBqh9Wixoi8O5bW591silNsJyg9dKwKjeslnWG_9cbYyn8QztaGAf-RKM1KaoFVE_voDhL7qFNnUjj_AYXWgGmvkDkVaiGSH0ZrCN6SMx3r_tr3Lli3YA-bADrZ7xqKkMlmdZW45hWAPJw34Lej7Ef4 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: b10b04082888494d9ce6803298fc56bf Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesGetTestJSON-1702956211 Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:34:56.244853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b10b04082888494d9ce6803298fc56bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b10b04082888494d9ce6803298fc56bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b10b04082888494d9ce6803298fc56bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b10b04082888494d9ce6803298fc56bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesGetTestJSON-1702956211 Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: b10b04082888494d9ce6803298fc56bf Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesGetTestJSON-1702956211 Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesGetTestJSON-1702956211-project Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c65b8b8717b74354a44b438d6360c5e5 Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesGetTestJSON-1702956211-project Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'e7778495-f408-4370-8e38-3ff1ea4a8fe7'} Oct 19 13:34:56.246634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. (HTTP 404) (Request-ID: req-687c1b89-7a2d-43e2-9bfa-831522c8b0dd) Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:56.247644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:34:56.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:34:56.251287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:56.254024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d22b82c6-b303-49bd-816b-1b7fe2662353 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] Returning 404 to user: Volume e7778495-f408-4370-8e38-3ff1ea4a8fe7 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:34:56.257578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d22b82c6-b303-49bd-816b-1b7fe2662353 tempest-VolumesGetTestJSON-1702956211 tempest-VolumesGetTestJSON-1702956211-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7" status: 404 len: 109 microversion: 2.1 time: 0.143863 Oct 19 13:34:56.259810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/os-volumes/e7778495-f408-4370-8e38-3ff1ea4a8fe7 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:34:56.272048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-441506c4-9354-4d8d-a1c8-e638488f7281 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.275029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-441506c4-9354-4d8d-a1c8-e638488f7281 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:56.504287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-441506c4-9354-4d8d-a1c8-e638488f7281 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.530540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-441506c4-9354-4d8d-a1c8-e638488f7281 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1222 microversion: 2.1 time: 0.269404 Oct 19 13:34:56.532915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:56.562274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-eba37d7a-d23b-46e0-b71b-feded825d6a4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.565103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-eba37d7a-d23b-46e0-b71b-feded825d6a4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:56.712531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-eba37d7a-d23b-46e0-b71b-feded825d6a4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.712699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:34:56.712699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:34:56.712699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:34:56.713306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:34:56.713306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:34:56.719186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-eba37d7a-d23b-46e0-b71b-feded825d6a4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1214 microversion: 2.1 time: 0.184711 Oct 19 13:34:56.720933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:56.723653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.724191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.724609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.725337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.725795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.726222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.742701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1219ee2b-186d-4b0a-86ff-bfb4d530aab1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e996670>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.774239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:34:57.073239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for user 6c828726ae814c0f879a5aa69f647a96 and project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:34:57.073239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:34:57.073239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:34:57.079213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1219ee2b-186d-4b0a-86ff-bfb4d530aab1 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 202 len: 0 microversion: 2.1 time: 0.327501 Oct 19 13:34:57.079213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 17/32] 10.222.0.39 () {58 vars in 1254 bytes} [Wed Oct 19 13:34:56 2022] DELETE /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:34:57.079213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f193b130-e5ea-4774-b275-1fff7e2f7ee7 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e996dc0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.170429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-43118b18-a9b4-4928-b7a9-b9136a7ac1d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.383482 Oct 19 13:34:57.181121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 16/33] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 13:34:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 13:34:57.212348 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-862770114", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:34:57.235492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f193b130-e5ea-4774-b275-1fff7e2f7ee7 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/446f681c-df07-4fae-ab0a-bbd0f8453ce1" status: 200 len: 351 microversion: 2.1 time: 0.174765 Oct 19 13:34:57.236059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 18/34] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/os-volumes/446f681c-df07-4fae-ab0a-bbd0f8453ce1 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:57.245278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9dda3bc6-de4c-4715-a10b-1fe9f338aaeb tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e996700>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.331090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] validate_networks() for [('ebe83939-e1a8-4db7-ba5f-97087a8d3d2e', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:34:57.430961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9dda3bc6-de4c-4715-a10b-1fe9f338aaeb tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 200 len: 286 microversion: 2.1 time: 0.192947 Oct 19 13:34:57.430961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 19/35] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:34:57.435784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.436390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:57.641706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.673411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.675146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.682389 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-54fd256a-bb39-416b-9b13-e7c9fb1c8785 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1280 microversion: 2.20 time: 0.244393 Oct 19 13:34:57.704028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 20/36] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:57.746987 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2f4a91ee-f67a-4aaf-bd68-b781cda6d2a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.747803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2f4a91ee-f67a-4aaf-bd68-b781cda6d2a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:58.041631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2f4a91ee-f67a-4aaf-bd68-b781cda6d2a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:58.053777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2f4a91ee-f67a-4aaf-bd68-b781cda6d2a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1214 microversion: 2.1 time: 0.311152 Oct 19 13:34:58.054786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 21/37] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:58.373808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:34:58.374592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:34:58.375205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:34:58.375916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:34:58.377272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:34:58.397550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.404660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.404660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.404660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.404660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.406464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.443581 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7aabf466-26e3-460f-9435-2631eef8491d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e9969d0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.463648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:34:58.474341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for user 020ff888a8a44d2eb6961829407637a9 and project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:34:58.491463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-7aabf466-26e3-460f-9435-2631eef8491d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] HTTP exception thrown: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7aabf466-26e3-460f-9435-2631eef8491d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Request method failure captured: Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 HTTP/1.1 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_zvEg8qoc4YvSe1I8akJpFWNlDB4YNGwUk1i63AX1IEKQ-zUvaWESSfRSqDexCE1VBiq2_lOd_FLLawAlX4eztjx-jPxouaALJeILrsA2exJulE4OmxBG0l4fTnfebTW-pk1rKlik2gnEFuw4xAk_y9XkkPzdzFmVTID5idOgdZf4U Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:34:58.493742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ddae0cb1d13b4d4bbbcb2ba46a39f6d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: fd3620e3535b4040896736ce79e38fd7 Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '50aacfa0-4fc0-407a-b5eb-36ab8ce94615'} Oct 19 13:34:58.495061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. (HTTP 404) (Request-ID: req-2cf42f3c-7ab2-43f1-93de-9bfd4f9e3598) Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.495814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:34:58.496808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 13:34:58.498652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. Oct 19 13:34:58.501164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:34:58.504189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:34:58.506392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:34:58.506719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7aabf466-26e3-460f-9435-2631eef8491d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Returning 404 to user: Snapshot 50aacfa0-4fc0-407a-b5eb-36ab8ce94615 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:34:58.507835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7aabf466-26e3-460f-9435-2631eef8491d tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615" status: 404 len: 111 microversion: 2.1 time: 0.068786 Oct 19 13:34:58.518795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 22/38] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/os-snapshots/50aacfa0-4fc0-407a-b5eb-36ab8ce94615 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:34:58.527901 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ded24c8a-ccc5-4acc-9461-57861116d1e7 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e996a60>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.737711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6c995407-31a2-4ca5-a172-6bcec25cf7a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.553892 Oct 19 13:34:58.749718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 17/39] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:34:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:34:58.755521 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.761473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:58.875385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:58.892550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:58.894904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:58.896786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-61f0090a-e715-45d9-b34f-961ac1a2c3b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1280 microversion: 2.20 time: 0.145560 Oct 19 13:34:58.897989 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 18/40] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:58.921409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ded24c8a-ccc5-4acc-9461-57861116d1e7 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 202 len: 0 microversion: 2.1 time: 0.383666 Oct 19 13:34:58.921409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 23/41] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:34:58 2022] DELETE /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:34:58.921907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3a8b000b-c59e-43e0-a101-828bca6a47cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.921907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3a8b000b-c59e-43e0-a101-828bca6a47cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:58.928012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1b5ab024-23f2-4b14-ad1f-a423b8ec962a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e989d30>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:59.053333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3a8b000b-c59e-43e0-a101-828bca6a47cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.062793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3a8b000b-c59e-43e0-a101-828bca6a47cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1221 microversion: 2.1 time: 0.163038 Oct 19 13:34:59.073908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 19/42] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:59.084909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:59.088237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:59.094710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.095411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.095856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.096580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.097152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.097450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.102162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1b5ab024-23f2-4b14-ad1f-a423b8ec962a tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.178350 Oct 19 13:34:59.103710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 24/43] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:34:59.282673 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.295295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-123c6f7a-a5dd-480b-8bab-6728fe257d74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1218 microversion: 2.1 time: 0.213938 Oct 19 13:34:59.305315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 20/44] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:59 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:59.938089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:59.938849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:59.945090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.945572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.946008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.946725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.949118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.949118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.098809 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.099954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:00.102140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.111695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.113675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.114305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.115202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.115816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.116549 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.119685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.121553 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.123040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6e99c73c-ae84-4070-8b5c-5aafd74336f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1284 microversion: 2.20 time: 0.189706 Oct 19 13:35:00.124931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 25/45] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:59 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:00.128913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-27ac8b43-c473-438b-846e-01dd3ef721ea tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e910dc0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.188561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-27ac8b43-c473-438b-846e-01dd3ef721ea tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.063444 Oct 19 13:35:00.189116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 26/46] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:00.201640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.211323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0aba28d9-90a2-41ac-9b47-ef5e511bfbdb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1225 microversion: 2.1 time: 0.117827 Oct 19 13:35:00.212056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 21/47] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:00.318940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.319672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:00.332712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.333837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.334601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.335419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.336080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.336581 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.420534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.435969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4d9a16c9-2795-425d-a22a-1aa20690cbae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1218 microversion: 2.1 time: 0.120561 Oct 19 13:35:00.454690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 27/48] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:01.150994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.151767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.159750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.160487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.161118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.162014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.162474 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.167211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.203919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-381769df-b993-4e19-bc3d-e9aa45b603ee tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e898f70>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.297057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.309171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.311172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.312554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9ed40a0a-24ca-4a00-9456-c0e001dcc4bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1284 microversion: 2.20 time: 0.165779 Oct 19 13:35:01.326534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 22/49] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:01.326534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.326534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.330971 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.331354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-381769df-b993-4e19-bc3d-e9aa45b603ee tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.132332 Oct 19 13:35:01.331763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.334549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 28/50] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:01.336176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.337133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.339755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.340328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.433273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.443587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8b8f217d-d257-40d0-8c54-1943ce17ed36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1225 microversion: 2.1 time: 0.128248 Oct 19 13:35:01.444346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 23/51] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:01.466439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.471040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.477779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.478457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.479171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.479881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.480384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.481082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.550892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.586794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-653b67b7-2a69-4b32-80be-c421c87d0317 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1210 microversion: 2.1 time: 0.126095 Oct 19 13:35:01.596559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 29/52] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:02.342367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.343054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:02.352669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3209830c-de24-4f79-b8c7-b12598d5aac4 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e898d30>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.353110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.353467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.353916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.354680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.355141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.355574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.442039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3209830c-de24-4f79-b8c7-b12598d5aac4 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 200 len: 345 microversion: 2.1 time: 0.099548 Oct 19 13:35:02.442926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 30/53] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:02.469049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.469775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:02.476190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.484142 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.491653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.492363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.493060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.495050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.496243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.496738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.497028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f1c079bd-18f4-401c-8210-169386b88294 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1276 microversion: 2.20 time: 0.159614 Oct 19 13:35:02.499244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.517794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 24/54] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:02.588093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.607377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b5061890-6f19-4eca-9508-6d3750a78ce2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1217 microversion: 2.1 time: 0.142179 Oct 19 13:35:02.608187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 31/55] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:02.615210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.616347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:02.634228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.635139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.635887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.637033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.637799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.639318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.687513 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-504a47de-776d-472f-8a75-8a9c01cae1a9 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e898c10>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.756792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.766638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-92e8c7d5-0f53-4694-b5d7-563240bf5cb8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1274 microversion: 2.1 time: 0.158041 Oct 19 13:35:02.767525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 25/56] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:02.792611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-504a47de-776d-472f-8a75-8a9c01cae1a9 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/08395aff-af2f-4867-9497-1f4ba64d9146" status: 200 len: 350 microversion: 2.1 time: 0.109330 Oct 19 13:35:02.793177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 32/57] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/os-volumes/08395aff-af2f-4867-9497-1f4ba64d9146 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:02.807354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a07b8a3b-fb27-4f6e-9a28-3d37813f117e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e955b80>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.916126 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a07b8a3b-fb27-4f6e-9a28-3d37813f117e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112767 Oct 19 13:35:02.916717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 26/58] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:02.932193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e875d730-bef7-4599-87d9-fa71aa72538e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e8a2160>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.023690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e875d730-bef7-4599-87d9-fa71aa72538e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095263 Oct 19 13:35:03.024260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 33/59] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:03.043422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d310a039-c63c-4bf6-aeb2-1499808aea8a tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e8a3dc0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.142085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d310a039-c63c-4bf6-aeb2-1499808aea8a tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102412 Oct 19 13:35:03.146406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 27/60] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:03.158992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-475aa30a-58f0-4be9-9483-23188eb4b028 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e910790>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.285723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-475aa30a-58f0-4be9-9483-23188eb4b028 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130492 Oct 19 13:35:03.286288 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 34/61] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:03.300593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e2791710-ff89-4a9c-82b6-83aa6a0d51c3 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e8a38b0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.420468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e2791710-ff89-4a9c-82b6-83aa6a0d51c3 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.124316 Oct 19 13:35:03.421048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 28/62] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:03.438531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15f5fbe4-2175-43d5-9d4d-2dd2f311b341 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e8668b0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.457375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb6e1a7b-ac34-437d-a13b-99ca0e3a14ed tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e948c10>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.545412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-15f5fbe4-2175-43d5-9d4d-2dd2f311b341 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.110510 Oct 19 13:35:03.545412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 35/63] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:03.557387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.558493 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:03.579758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.583221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.597840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.598832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.615786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.615786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.660749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-fb6e1a7b-ac34-437d-a13b-99ca0e3a14ed tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] HTTP exception thrown: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb6e1a7b-ac34-437d-a13b-99ca0e3a14ed tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Request method failure captured: Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 HTTP/1.1 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_zvEg8qoc4YvSe1I8akJpFWNlDB4YNGwUk1i63AX1IEKQ-zUvaWESSfRSqDexCE1VBiq2_lOd_FLLawAlX4eztjx-jPxouaALJeILrsA2exJulE4OmxBG0l4fTnfebTW-pk1rKlik2gnEFuw4xAk_y9XkkPzdzFmVTID5idOgdZf4U Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:35:03.665190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ddae0cb1d13b4d4bbbcb2ba46a39f6d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: fd3620e3535b4040896736ce79e38fd7 Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '64abc60e-f5c0-490f-856b-a836ab54a1b8'} Oct 19 13:35:03.666183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. (HTTP 404) (Request-ID: req-58c4de7e-56ca-4662-8589-45e0fe7a6560) Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:03.666955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:35:03.667836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:35:03.668704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb6e1a7b-ac34-437d-a13b-99ca0e3a14ed tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Returning 404 to user: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:35:03.669656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fb6e1a7b-ac34-437d-a13b-99ca0e3a14ed tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 404 len: 109 microversion: 2.1 time: 0.215375 Oct 19 13:35:03.680513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 29/64] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 109 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:35:03.691423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7b027dee-63f5-4fb8-a965-d1fae8de9d92 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e963b80>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.928004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.935568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7b027dee-63f5-4fb8-a965-d1fae8de9d92 tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.253199 Oct 19 13:35:03.936273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 30/65] 10.222.0.39 () {58 vars in 1188 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:03.954051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.956086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:03.963528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.984384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.991517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-69272b3a-eba4-44a1-ac7a-15d347331f72 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1276 microversion: 2.20 time: 0.443704 Oct 19 13:35:03.993633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 36/66] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1276 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:03.999126 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.003411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.004111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.005050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.007470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.008788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.014704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fd3c2754-9d0e-4802-9bb5-58ba14c19a73 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e8c9820>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.089764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-fd3c2754-9d0e-4802-9bb5-58ba14c19a73 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] HTTP exception thrown: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fd3c2754-9d0e-4802-9bb5-58ba14c19a73 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Request method failure captured: Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 HTTP/1.1 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_zvEg8qoc4YvSe1I8akJpFWNlDB4YNGwUk1i63AX1IEKQ-zUvaWESSfRSqDexCE1VBiq2_lOd_FLLawAlX4eztjx-jPxouaALJeILrsA2exJulE4OmxBG0l4fTnfebTW-pk1rKlik2gnEFuw4xAk_y9XkkPzdzFmVTID5idOgdZf4U Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:35:04.092597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ddae0cb1d13b4d4bbbcb2ba46a39f6d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: fd3620e3535b4040896736ce79e38fd7 Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '64abc60e-f5c0-490f-856b-a836ab54a1b8'} Oct 19 13:35:04.093696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. (HTTP 404) (Request-ID: req-c53e3c32-f537-41ec-ad23-418ddb4d64d9) Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.094331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:35:04.095564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 13:35:04.097322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fd3c2754-9d0e-4802-9bb5-58ba14c19a73 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Returning 404 to user: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fd3c2754-9d0e-4802-9bb5-58ba14c19a73 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 404 len: 109 microversion: 2.1 time: 0.097242 Oct 19 13:35:04.100850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 37/67] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:35:03 2022] DELETE /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:35:04.110320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.115069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:04.123999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.124399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.124979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.127326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.127819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.128255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.228325 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.240274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7af088e4-7028-49fa-b0fe-7ff7d63b3f67 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1273 microversion: 2.1 time: 0.302361 Oct 19 13:35:04.241739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 31/68] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:04.248874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e730795e-3ee2-4a97-b607-695cb85f996e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] Calling method '.version_select at 0x7fb41e8c54c0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.276082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.304760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e359f2be-b714-4ca0-85ed-8255e7899eba tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1272 microversion: 2.1 time: 0.201831 Oct 19 13:35:04.304760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 38/69] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:04.316437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3b48d32-b9dc-4889-b95f-f69c32e82482 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Calling method '.version_select at 0x7fb41e898ee0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.464234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e730795e-3ee2-4a97-b607-695cb85f996e tempest-VolumesTestJSON-350640959 tempest-VolumesTestJSON-350640959-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221152 Oct 19 13:35:04.465204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 32/70] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:04.514223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-d3b48d32-b9dc-4889-b95f-f69c32e82482 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] HTTP exception thrown: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3b48d32-b9dc-4889-b95f-f69c32e82482 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Request method failure captured: Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 HTTP/1.1 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_zvEg8qoc4YvSe1I8akJpFWNlDB4YNGwUk1i63AX1IEKQ-zUvaWESSfRSqDexCE1VBiq2_lOd_FLLawAlX4eztjx-jPxouaALJeILrsA2exJulE4OmxBG0l4fTnfebTW-pk1rKlik2gnEFuw4xAk_y9XkkPzdzFmVTID5idOgdZf4U Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:35:04.516385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ddae0cb1d13b4d4bbbcb2ba46a39f6d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ddae0cb1d13b4d4bbbcb2ba46a39f6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: ddae0cb1d13b4d4bbbcb2ba46a39f6d0 Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-158848400 Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: fd3620e3535b4040896736ce79e38fd7 Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesSnapshotsTestJSON-158848400-project Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '64abc60e-f5c0-490f-856b-a836ab54a1b8'} Oct 19 13:35:04.517543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. (HTTP 404) (Request-ID: req-a7587cd6-3193-409f-b8eb-a75f5b135874) Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.518183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:35:04.519208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:35:04.520088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3b48d32-b9dc-4889-b95f-f69c32e82482 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] Returning 404 to user: Volume 64abc60e-f5c0-490f-856b-a836ab54a1b8 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d3b48d32-b9dc-4889-b95f-f69c32e82482 tempest-VolumesSnapshotsTestJSON-158848400 tempest-VolumesSnapshotsTestJSON-158848400-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8" status: 404 len: 109 microversion: 2.1 time: 0.211612 Oct 19 13:35:04.520962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 39/71] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/os-volumes/64abc60e-f5c0-490f-856b-a836ab54a1b8 => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:35:05.022369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.026095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.052658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.054343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.056075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.057945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.061667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.063087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.218739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.227360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.240235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.241589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1ebdb106-397f-47be-888b-c7a5821f894d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1332 microversion: 2.20 time: 0.223181 Oct 19 13:35:05.254619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 33/72] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:05.272158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.272388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.284812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.305622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.306133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.306906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.308105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.316603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.329217 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.329811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.342944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.344380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.346527 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.351435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.352168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.353953 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.429803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:05.533281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.550849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f9a200ac-09b0-41a6-92af-f1f5dc38cd62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1279 microversion: 2.1 time: 0.285098 Oct 19 13:35:05.551452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 40/73] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:05.986445 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.014916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c01960d9-08aa-4c1b-b0c5-db57a56e7e1d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.689398 Oct 19 13:35:06.031455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 34/74] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:06.293658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:06.293658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:06.293658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.293658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.296013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.296013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.296013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.296013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.528752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.539652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.542575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.543815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c23c198b-f26d-4e55-9467-abec10d23242 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1340 microversion: 2.20 time: 0.275125 Oct 19 13:35:06.554543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 41/75] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:06 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1340 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:06.577835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:06.579177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:06.587048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.587535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.594388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.595164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.595633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.596056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.757779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.767121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-99fee71f-2d5a-4154-aeb7-a3a36944a1f4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1279 microversion: 2.1 time: 0.195001 Oct 19 13:35:06.769168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 35/76] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:06 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:07.039897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:07.040852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:07.049120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.050879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.056914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.057751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.058301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.059010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.506089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.518456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2c211ddd-c00b-4c1f-97b9-c913ed86ab79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.482625 Oct 19 13:35:07.541465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 42/77] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:07 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:07.576170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:07.583410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:07.589982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.590680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.600661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.601588 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.602171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.602711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.756178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.769687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.774287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.778241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-acd72d96-2bf9-46b5-8567-aca4dfcdc981 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1338 microversion: 2.20 time: 0.204730 Oct 19 13:35:07.780188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 36/78] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:07 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:07.810878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:07.812134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:07.834635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.836242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.842476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.847143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.850243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.854252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.049803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=14 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:08.554684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:08.555350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:08.557388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:08.574091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.577040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.577631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.578276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.578978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.579406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.988141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.999383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-11b154e3-c58a-4f1f-9c5b-2e4866aa80cc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 1.210647 Oct 19 13:35:09.019209 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 43/79] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:07 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:09.027467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:09.028526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:09.035819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.036859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.037471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.038481 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.039345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.039944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.057903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=26 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:09.120621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.130688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1c2d9af4-595a-4949-8227-0dfd4c3601c0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.585184 Oct 19 13:35:09.137410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 37/80] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:08 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:09.191761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.216456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.218219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.227448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6182ad8c-1b9e-4418-bc73-30af74d7909d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1338 microversion: 2.20 time: 0.199154 Oct 19 13:35:09.229299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 44/81] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:09 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:10.034259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.040018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.050386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.051210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.051826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.052694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.053548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.054286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.169299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.169968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.180801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.181352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.182225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.183681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.184573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.185236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.609902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.618932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-abb30161-bafc-4b2f-ac8c-8f61bcd25b2f tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.453673 Oct 19 13:35:10.639652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 45/82] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:10.656321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.657968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.679620 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.680233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.681827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.683807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.686285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.689259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.926400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.935898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5a0b6b40-5c9e-4f34-88f5-ebf606f14ee4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.907351 Oct 19 13:35:10.942261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 38/83] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:11.225100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999a9976-a51e-4933-8342-5c862b9a574a", "tag": "293c7801-b3d7-4169-b547-c04ea8e9fe4d"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:11.287957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.288448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.293409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.356772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Creating event network-changed:293c7801-b3d7-4169-b547-c04ea8e9fe4d for instance 999a9976-a51e-4933-8342-5c862b9a574a on hv-cinder-86188 Oct 19 13:35:11.357775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 13:35:11.359093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5f89306d-be56-4240-b16e-0f9e6a1ee093 req-99d145e4-477c-42e0-9f2e-d0e7816d500c service nova] Acquired lock "compute-rpcapi-router" {{(pid=125748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 13:35:11.360528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.361268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.362194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.364758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.365455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.366764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.400322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.compute.rpcapi [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 13:35:11.417367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] Releasing lock "compute-rpcapi-router" {{(pid=125748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 13:35:11.451791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9c5cf773-a5fd-4f14-a22a-d28de6befd3e None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506697 Oct 19 13:35:11.462017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 39/84] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:11.575461 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6206e4-6de7-4933-bfb2-2a39c28f56db", "tag": "9c36380a-941f-4089-ba11-68e2dee4d597"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:11.602199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:11.638563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.640209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.642910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.692794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] Creating event network-changed:9c36380a-941f-4089-ba11-68e2dee4d597 for instance fb6206e4-6de7-4933-bfb2-2a39c28f56db on hv-cinder-86188 Oct 19 13:35:11.714831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.734335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-1c4c42f4-76e9-4bba-9f5b-1f9b20b89e5f req-659b73ee-40ba-44c4-ab73-4c85a89c8a52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242756 Oct 19 13:35:11.734335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 40/85] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:11.759234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.779132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.789917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8c982088-4a5b-4884-b49b-9d7902c406ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 1.144535 Oct 19 13:35:11.790564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 46/86] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:11.790737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:11.794145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:11.822939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.822939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.822939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.822939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.823513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.823513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.968922 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:11.969539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:11.979060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.979579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.988095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.989034 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.989568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.989970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.598405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.615619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a044b513-f7e7-41c7-bda0-e5e3d0c8e809 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.878869 Oct 19 13:35:12.616358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 41/87] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:11 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:12.818102 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:12.818753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:12.827304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.838530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.842338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.842338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.842338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.842338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.842777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.844403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6d45ae4b-8803-42e5-bef1-4e3ad6d99956 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.877823 Oct 19 13:35:12.846017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 47/88] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:11 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:12.926084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:13.555208 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.569674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.578646 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.580342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-09c2f133-c572-4709-9f7e-f843375d81b6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.765986 Oct 19 13:35:13.581271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 42/89] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:12 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:13.641687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:13.642649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:13.649936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.650712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.651301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.652148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.652749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.653401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.868886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:13.869787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:13.896334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.896823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.899224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.904093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.905186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.906261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.112760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.124011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8a360ace-218a-49b0-80ed-76d93bd4d655 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.259445 Oct 19 13:35:14.125706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 43/90] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:13 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:14.131085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92822db-4152-4a45-ac06-25873b8fb608", "tag": "875550b0-cee5-41db-a2c8-5e4b2a1406ac"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:14.143838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.144321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.144815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.156901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] Creating event network-changed:875550b0-cee5-41db-a2c8-5e4b2a1406ac for instance a92822db-4152-4a45-ac06-25873b8fb608 on hv-cinder-86188 Oct 19 13:35:14.165964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-7e5ffdcc-498b-46a6-9dcc-c73c15647c35 req-1709852b-9eb7-4b97-a28b-476331ffa991 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038490 Oct 19 13:35:14.167990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 44/91] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:14.607706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:14.608465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:14.625418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.627451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.630568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.631344 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.631958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.632497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.741157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.771045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f9cf84df-738a-4a6d-ba2e-32be30045cd4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 1.133032 Oct 19 13:35:14.776714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 48/92] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:13 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:14.962615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.017972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.020726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.023208 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-028ddb5e-7a1c-41a8-9b58-b6a18a0e7deb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.421046 Oct 19 13:35:15.026188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 45/93] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:14 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:15.152113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:15.153065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:15.161539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.162214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.172024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.173419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.174113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.175002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.459556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.469346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ec04300e-b7c0-404c-b9f7-5a73f9f53ea8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.321093 Oct 19 13:35:15.469930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 49/94] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:15 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:15.799962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:15.801010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:15.814450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.815097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.816235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.817652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.819442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.820436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.055711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:16.057362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:16.057711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.071824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8ce07f73-4a86-4689-bb9e-54f922e3739e tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.273499 Oct 19 13:35:16.071824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 46/95] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:15 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:16.071958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.071958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.071958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.071958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.072198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.074470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.079974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:16.220413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:16.229876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.230423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.230880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.234976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.252336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] Creating event network-changed:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:35:16.253917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.255011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-eed15254-9187-4a85-9c0a-9660876d4c84 req-33770758-d00b-4822-b258-2061a60052b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038746 Oct 19 13:35:16.255566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 47/96] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:16.267264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.268822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ee70fe9f-f005-4ae5-852b-0f591746cd58 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.219880 Oct 19 13:35:16.270170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 50/97] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:16 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:16.500455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:16.501162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:16.507460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.507943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.508374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.509097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.509553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.509973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.680547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.693411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1b6538e3-9d55-4455-8f2f-a86c21a9b051 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.195485 Oct 19 13:35:16.693411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 48/98] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:16 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:17.094239 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.094995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.109720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.110583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.111206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.115577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.115577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.115577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.259327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.279621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d07b8d14-bbc9-4ae4-ae81-d2cf9ee419e1 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.190545 Oct 19 13:35:17.280235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 51/99] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:17.296533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.297259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.303449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.303931 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.304464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.305876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.306352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.306802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.464708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.472961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.474592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.475709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c5d6e0f9-4dd4-43ca-9630-29c7bb4c6a7e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.184024 Oct 19 13:35:17.476263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 49/100] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:17.718228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.718882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.726852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.727794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.728404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.729673 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.730129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.731172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.871189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.879604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-56360fe1-1bf4-4be2-9d5c-8df4e0d315ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.168636 Oct 19 13:35:17.890566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 52/101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:18.301910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:18.302532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:18.308957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.309499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.310036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.310895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.311338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.314388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.454079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.461764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ead6bb14-3b75-4d95-a87a-ef6a8dae21ca tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.163572 Oct 19 13:35:18.462275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 50/102] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:18 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:18.500704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:18.501337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:18.507329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.507801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.508229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.508962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.509411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.509828 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.653830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.662095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.663585 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.664985 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1b122c6b-299a-41d3-b882-0a64c8575e48 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.168299 Oct 19 13:35:18.665683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 53/103] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:18 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:18.903730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:18.904378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:18.910262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.910788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.911283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.912047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.912498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.912914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.049219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.058237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fd15d3e8-1993-4458-bb5d-a2a26457f80b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.158906 Oct 19 13:35:19.083363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 51/104] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:18 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:19.485078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:19.485540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:19.491308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.491780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.492207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.492881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.493338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.493752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.625908 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.634852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f4d99c15-dcc6-4a55-88e9-f31426f2a43a tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.153648 Oct 19 13:35:19.635438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 54/105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:19 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:19.696482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:19.697091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:19.703749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.704327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.704687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.705677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.706226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.706599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.836991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.846924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.848696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.849791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5d8e8c3f-d5ab-4312-9d62-46ac4d3f813a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.157229 Oct 19 13:35:19.850329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 52/106] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:19 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:20.089988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.090911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.098046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.098848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.103544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.103544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.103544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.103544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.279812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.291213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-df472a3b-d759-4f04-865c-45b2a0045030 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.205155 Oct 19 13:35:20.292867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 55/107] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:20 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:20.663573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.666848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.678661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.679099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.685242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.686009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.686818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.690428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.850410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.859232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-89631c9d-4ad7-420d-9ef7-36def64ec8ea tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.199604 Oct 19 13:35:20.861845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 53/108] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:20 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:20.876505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.879323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.886237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.886854 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.888138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.888834 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.889288 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.889712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.049646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.060470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.062316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.063925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-43943ead-91b1-477d-b887-6793db4e353e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.191800 Oct 19 13:35:21.064597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 56/109] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:20 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:21.336400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:21.336400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:21.336400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.336400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.336773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.336773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.336773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.336967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.383899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:21.547372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.562051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-48c5da91-033e-40f1-b3fa-4b844910aec2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.246533 Oct 19 13:35:21.563315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 54/110] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:21 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:21.886274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:21.890357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:21.902698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.903973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.904614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.905624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.906163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.906708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.090191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:22.091446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:22.099740 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.100777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.101425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.102338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.103174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.103787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.129494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.137247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4991f993-aa87-40fb-953c-f9be55b201a7 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.255026 Oct 19 13:35:22.154115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 57/111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:21 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:22.311205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.319857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.321316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.322439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-afe0b8eb-a2aa-49be-a678-3a69a1e8540d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.237208 Oct 19 13:35:22.323026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 55/112] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:22 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:22.592608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:22.594661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:22.600430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.600915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.601457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.602146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.602813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.603383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.919715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.928251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aafad472-3a44-4e8e-a8c0-f9e369e39a6e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.343993 Oct 19 13:35:22.929101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 58/113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:22 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:23.161396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.163254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.171270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.172007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.172445 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.173331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.173716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.174291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.348420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.348930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.351802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:23.355418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.356308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.356785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.357707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.358218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.358844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.365575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.374322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c451c8d0-4e33-4a17-9530-4ef8230019e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.216930 Oct 19 13:35:23.374913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 56/114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:23.558394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.576298 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.577887 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.579165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b0cb1a05-fbcb-431b-a8cc-7d582d93b0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.236105 Oct 19 13:35:23.587040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 59/115] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:23.951637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.952487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.958796 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.959280 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.959718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.960439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.960965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.961416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.107539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.115363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ff356a18-f987-43d4-b6d3-87a3564590e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.167536 Oct 19 13:35:24.115942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 57/116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:24.397348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:24.398219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:24.405904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.406621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.407117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.408122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.408746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.409455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.548689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.558333 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cb3bc306-dbb7-4cdb-8bf3-e4ff007a608d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.164956 Oct 19 13:35:24.559114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 60/117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:24 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:24.613106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:24.614398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:24.620839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.621574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.622120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.623013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.623633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.624267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.772254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.779052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.781006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.782261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0f43978e-e83c-44b1-8aa5-08fd45222d3a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.173575 Oct 19 13:35:24.782852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 58/118] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:24 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:25.139357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:25.140043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:25.146078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.146604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.147232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.148085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.148683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.149320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.306345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:25.314335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-111e532b-ea11-47bb-bd77-dd66924081ed tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.180055 Oct 19 13:35:25.314939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 61/119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:25 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:25.582572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:25.583467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:25.589816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.591276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.591967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.593301 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.593751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.594172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.739472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:25.747520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-077e788d-092c-4b74-846a-45822ff59d81 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.169281 Oct 19 13:35:25.748183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 59/120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:25 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:25.807531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:25.808112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:25.814755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.815231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.815717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.816399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.816872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.817288 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.953018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:25.961399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:25.963040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:25.964145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bc249e6d-7745-48bb-a21e-8841a523048b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.161010 Oct 19 13:35:25.964913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 62/121] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:25 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:26.339969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:26.341014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:26.348384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.349454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.350108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.351184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.351819 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.352542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.380531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:26.535067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.547116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5f52b1db-5886-4d3a-8902-42c84602bb45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.213533 Oct 19 13:35:26.547853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 60/122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:26 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:26.770694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:26.771503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:26.778840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.779466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.780017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.780801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.781326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.781813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.992773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:26.993514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:27.000818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.001307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.001738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.002433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.002920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.003373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.086624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.100857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-99417bc3-aec6-48f4-b092-efab7da7e087 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.334081 Oct 19 13:35:27.101567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 63/123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:26 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:27.147152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.155302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.156770 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.160843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6785aec8-7ccc-403d-af10-1dd04775dd18 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.172401 Oct 19 13:35:27.162208 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 61/124] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:26 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:27.570451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:27.571084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:27.577010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.577489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.577920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.578629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.579088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.579510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.716794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.724543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b0ca4193-2ac0-4976-9f04-6d2ecf52319d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.157934 Oct 19 13:35:27.725104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 64/125] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:27 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:28.124201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:28.125456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:28.131317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.131797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.132230 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.132912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.133358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.133778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.183390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:28.184737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:28.191126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.191819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.192272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.192968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.193421 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.193844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.295754 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.306425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b07dbf9b-42c5-4c38-b06d-c0e24cca1fac tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.186532 Oct 19 13:35:28.308293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 62/126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:28 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:28.378033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.396030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.397803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.399050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-46b2a707-2961-467c-8342-9e3fd3782390 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.219566 Oct 19 13:35:28.399682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 65/127] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:28 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:28.749057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:28.749957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:28.756405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.757265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.757860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.759379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.760561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.761148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.932548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.940852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ba18cc18-4a76-45d4-9f61-cd676f010bee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.196573 Oct 19 13:35:28.941381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 63/128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:28 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:29.336362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:29.336975 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:29.343615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.344511 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.344944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.345729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.346178 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.346681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.428363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:29.429899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:29.441623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.448330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.448330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.448330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.448330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.448625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.535080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.538840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:29.546604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d1abdf91-7344-4e5c-af00-b1546afa4f56 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.215464 Oct 19 13:35:29.546604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 66/129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:29 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:29.637628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.646400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.647965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.648599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d768524d-4418-4e5b-bfc3-616b777cd9ed tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.225033 Oct 19 13:35:29.649154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 64/130] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:29 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:29.964774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:29.982126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:29.996204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.996706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.001419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.002781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.003263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.003698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.199410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.208977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e8a8023a-2e69-4b82-ba2b-e767c00a1e8a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.248427 Oct 19 13:35:30.210354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 67/131] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:29 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:30.571473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:30.572074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:30.586154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.588671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.589490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.590923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.591592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.592096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.673904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:30.675225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:30.681465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.681942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.682714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.683598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.684284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.684926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.775359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.786214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-76ce5e6a-514f-4a08-a72f-cba9c81cb58b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.218436 Oct 19 13:35:30.787220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 65/132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:30 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:30.820328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.830702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.832730 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.834718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-24de56f9-8969-4a17-ba3b-d60e4c50ad45 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.165205 Oct 19 13:35:30.835829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 68/133] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:30 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:31.233683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:31.234171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:31.240615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.241319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.241750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.242443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.242950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.243380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.399228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:31.409323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bcfbb59d-2f01-42f7-bba7-38f18f444371 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.180650 Oct 19 13:35:31.409894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 69/134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:31 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:31.489575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6206e4-6de7-4933-bfb2-2a39c28f56db", "name": "network-vif-plugged", "status": "completed", "tag": "9c36380a-941f-4089-ba11-68e2dee4d597"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:31.505298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.505714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.506184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.521929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] Creating event network-vif-plugged:9c36380a-941f-4089-ba11-68e2dee4d597 for instance fb6206e4-6de7-4933-bfb2-2a39c28f56db on hv-cinder-86188 Oct 19 13:35:31.528290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-d5b20cb2-ad40-4988-961d-518aca25ed19 req-52772dc6-d5e6-42fc-90da-8c0604b80bf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388412 Oct 19 13:35:31.531543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 66/135] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:31.810393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:31.813100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:31.821916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.822246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.822661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.823355 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.823837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.824450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.861786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:31.866381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:31.877066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.877830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.878405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.879267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.880048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.880619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.965780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:31.975199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-30bdaf8c-268c-4a8f-ba2e-f0a195ae9551 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.169589 Oct 19 13:35:31.975768 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 70/136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:31 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:32.032823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.042270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.043798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.044913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5281c8b2-44f7-41a0-9685-465e8e0817e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.187402 Oct 19 13:35:32.047971 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 67/137] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:31 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:32.431572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:32.432272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:32.439117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:32.439698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:32.440019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:32.440708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:32.441163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:32.441586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:32.623303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.634020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c3ece8bb-ddd7-4159-88f7-3063f742fad0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.206218 Oct 19 13:35:32.638531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 71/138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:32 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:33.002372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:33.002372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:33.004874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.005510 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.006648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.009026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.009694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.010488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.077182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:33.077798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:33.097088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.097088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.097088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.097323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.097965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.098299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.224707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.233654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3840aa65-c876-4d5c-872c-825e8868f9f8 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.240236 Oct 19 13:35:33.261548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 68/139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:32 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:33.400238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.411918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.413668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.415174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1dd569b5-c8f0-4216-8b16-90ce617ca524 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.344739 Oct 19 13:35:33.432308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 72/140] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:33 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:33.554031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999a9976-a51e-4933-8342-5c862b9a574a", "name": "network-vif-plugged", "status": "completed", "tag": "293c7801-b3d7-4169-b547-c04ea8e9fe4d"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:33.568128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.568807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.569370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.583001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] Creating event network-vif-plugged:293c7801-b3d7-4169-b547-c04ea8e9fe4d for instance 999a9976-a51e-4933-8342-5c862b9a574a on hv-cinder-86188 Oct 19 13:35:33.589769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-521a66e7-8750-4a73-ad94-b67fd0a79f39 req-7f097195-be9e-4931-b69d-bc7412af9987 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 Oct 19 13:35:33.590682 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 69/141] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:33.657297 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:33.657722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:33.663956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.664439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.664868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.665738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.666338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.667051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.819340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.828377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f3539194-6699-4aa7-b189-a1cae31ba6f9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.174961 Oct 19 13:35:33.829048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 73/142] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:33 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:34.270917 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:34.272060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:34.280127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.280628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.281317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.281923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.282376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.283016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.443818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:34.445354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:34.450606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.453160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.453902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.454555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.455662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.456396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.456966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.466677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-11951c72-e84b-4ef9-95d6-e17f2da6733d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.207140 Oct 19 13:35:34.475081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 70/143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:34 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:34.691033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.699822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.701369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.702636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-16b25abe-2b0a-4a75-b905-173d88a772df tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.263007 Oct 19 13:35:34.703201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 74/144] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:34 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:34.864292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:34.864880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:34.872265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.872751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.873176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.874039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.874681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.875101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.111849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.119650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-eb9ab50e-ee7d-44ef-9497-4da348c2132a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.261613 Oct 19 13:35:35.120223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 71/145] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:34 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:35.499473 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:35.500042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:35.508580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.509066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.509498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.510195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.510670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.513348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.618032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92822db-4152-4a45-ac06-25873b8fb608", "name": "network-vif-plugged", "status": "completed", "tag": "875550b0-cee5-41db-a2c8-5e4b2a1406ac"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:35.643549 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.644020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.644693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.672492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] Creating event network-vif-plugged:875550b0-cee5-41db-a2c8-5e4b2a1406ac for instance a92822db-4152-4a45-ac06-25873b8fb608 on hv-cinder-86188 Oct 19 13:35:35.683726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-260b029e-29a3-4335-a17f-5469923be38c req-c34b555d-9893-4a2f-b4a7-2e8db9fc36e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076937 Oct 19 13:35:35.690998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 72/146] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:35.728589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.729328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:35.730026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:35.737152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fcb2c898-d7a9-4bf8-b8c3-7171c23a3fbc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1314 microversion: 2.1 time: 0.242216 Oct 19 13:35:35.737559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 75/147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:35 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:35.743490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.747759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.747759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.747759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.747759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.748046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.960414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.971115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.973274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.974810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-70822142-a604-4e1c-bcf9-7e60fa0913be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.249802 Oct 19 13:35:35.976062 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 73/148] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:35 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:36.144156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:36.144699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:36.150695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.151364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.151798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.153045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.153664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.159343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.335675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.343846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4414f63b-3196-493f-8da9-c4039f91a1f1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.204295 Oct 19 13:35:36.344406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 76/149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:36 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:36.764545 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:36.765915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:36.773182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.773873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.778472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.778472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.778472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.778472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.978559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.990087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ffd4bd1e-9a5e-48dc-9f87-84cf0be358ae tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1500 microversion: 2.1 time: 0.234629 Oct 19 13:35:36.993216 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:36 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1500 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:37.001434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:37.002597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:37.030292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.034067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.034067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.034067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.034067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.034529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.209018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.218065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.219656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.220784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8e996177-a49e-4d7c-9a88-4cf5dcfe2ee8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.223312 Oct 19 13:35:37.221506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 77/151] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:36 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:37.367455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:37.368064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:37.374034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.374846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.376932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.376932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.377172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.377750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.534966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.544824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-27226ba3-6a12-4ecd-a184-7126b50699c1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.181095 Oct 19 13:35:37.555319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 75/152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:37 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:37.706309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "name": "network-vif-plugged", "status": "completed", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:37.719320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.719851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.720485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.740142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Creating event network-vif-plugged:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:35:37.740767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 13:35:37.742093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1d9670d-3d52-4600-aca8-69742d717553 req-8f2dc0e4-305d-41cb-81cd-b5391a759929 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 13:35:37.742381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.742994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.743521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.744380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.745073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.745586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.755388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.compute.rpcapi [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 13:35:37.756373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] Releasing lock "compute-rpcapi-router" {{(pid=125749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 13:35:37.783398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e7261765-6b3d-4cae-bd36-2467fc36daa0 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085254 Oct 19 13:35:37.785823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 78/153] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:38.247613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:38.248227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:38.253970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.254448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.254914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.255601 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.256054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.256504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.415643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.423009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.430722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.431871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f7b483fa-cd8d-410c-9803-0eed93956c80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.188802 Oct 19 13:35:38.432429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 76/154] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:38 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:38.570080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:38.570999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:38.577569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.578055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.578491 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.579221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.579668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.580467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.749558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.758334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-066390b6-fa14-4b4a-9274-19fd43592e8f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.192717 Oct 19 13:35:38.773763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 79/155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:38 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:39.461057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:39.461752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:39.468386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.468889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.469302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.469988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.470438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.470948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.618576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.627155 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.628599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.629713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-52393f0f-d9d6-4038-8f1c-e3da9bcfa66a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.172488 Oct 19 13:35:39.630275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 77/156] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:39 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:39.782466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:39.782466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:39.789016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.789710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.790523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.791465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.792122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.792754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.930900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.939187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0a39aa6f-b4bd-4d75-83bd-6cb932bc075e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.162020 Oct 19 13:35:39.939751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 80/157] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:39 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:40.655143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:40.655744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:40.661575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.662053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.662482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.663251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.666634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.667150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.811465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.819555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.821040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.822179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-396dc5c6-7fd1-404d-81a5-c6c057a09277 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.171104 Oct 19 13:35:40.822739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 78/158] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:40 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:40.962130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:40.963304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:40.969709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.970112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.970564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.971250 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.971698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.972126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.103300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:41.111822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-83e385a0-58f9-4541-ac9d-1efa7b2eba12 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.153551 Oct 19 13:35:41.112378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:40 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:41.846166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:41.847097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:41.853755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.854226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.854913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.856118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.856627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.861293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:41.996499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.006176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.008196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.008758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f8543f4b-8b2e-41c5-8769-83269039048a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.166783 Oct 19 13:35:42.009464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 79/160] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:41 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:42.138539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:42.139170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:42.145753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:42.146230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:42.148517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:42.148517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:42.148517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:42.148517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:42.292207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.300753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cb634523-290d-4494-a543-e08e57031ec6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1321 microversion: 2.1 time: 0.166753 Oct 19 13:35:42.301306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:42 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:43.039314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:43.039862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.046657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.047127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.047555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.048228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.048676 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.049089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.212024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.220466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.221929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.223043 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1c4d69a4-fd48-4af0-b6ad-dfec7d2572b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.187723 Oct 19 13:35:43.223626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 80/162] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:43 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:43.324767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:43.325315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.331236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.331719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.332182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.332866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.333310 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.333730 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.463177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.467353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:43.472122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6a9710d1-16eb-4b6c-bc19-9fdda934fadf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1513 microversion: 2.1 time: 0.151581 Oct 19 13:35:43.472684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 83/163] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:43 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:43.496827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:43.500120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.508521 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.509227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.509714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.510615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.511185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.511711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.583019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'flavor' on Instance uuid a92822db-4152-4a45-ac06-25873b8fb608 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:35:43.724332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35ab0a05-460e-452c-a7f9-16521a9b4cdb"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:43.725906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.732410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.733125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.733635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.734456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.735053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.735561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.978731 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-49b8d8be-f501-4a5f-8788-2c7526f9676b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608/action" status: 200 len: 32 microversion: 2.1 time: 0.486033 Oct 19 13:35:43.979451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 81/164] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:35:43 2022] POST /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:35:43.989540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:43.990240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.992209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=83 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:43.997577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.998011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.998447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.999182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.999639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.000073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.140054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.148795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-da3f9ce3-5dcf-436c-acab-8f95ddf97eff tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.163390 Oct 19 13:35:44.149799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:43 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:44.248505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:44.249124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:44.254913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.255395 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.261476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.261476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.261476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.261476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.386644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.394782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.396212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.397297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5d5e1f7b-bf21-4049-a1bd-7c587a6d0108 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.153353 Oct 19 13:35:44.397856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 83/166] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:44 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:45.173089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:45.173712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:45.179666 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.180272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.180600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.181287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.181741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.182171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.307173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.315248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0e0d4afe-52d7-43c7-906f-6369fad188e2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.147013 Oct 19 13:35:45.315829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 84/167] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:45 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:45.422254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:45.423079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:45.428985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.429464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.429903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.430619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.431081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.431513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.561115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.569090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.570557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.571634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f8857f7b-e03a-4cea-9f9d-93be8ed36577 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.153831 Oct 19 13:35:45.572177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 85/168] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:45 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:46.338135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:46.338758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:46.344696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.345172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.345609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.346286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.346767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.347191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.472135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.479692 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1c1de5a8-4a84-428b-b9b2-0a9ab4fe47b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.145310 Oct 19 13:35:46.480247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 86/169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:46 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:46.596204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:46.596797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:46.602420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.602934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.603365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.604045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.604488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.604906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.730824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.739338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.740774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.741858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d32d3d15-f6fd-4119-af2b-e3835c0b85d8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.149249 Oct 19 13:35:46.742412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 87/170] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:46 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:47.503289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:47.503929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:47.509799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.510275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.510752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.511435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.511887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.512969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.635705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.643898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-05fc7172-6f69-4e65-8e1e-51a1352be02a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.144380 Oct 19 13:35:47.644466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 88/171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:47 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:47.753587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:47.766929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:47.767548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:47.773317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.773812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.774234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.774963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.775408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.775837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.903392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.911820 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.913251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.914406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9db165e0-4bd8-47f4-b741-dd71520730c5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1405 microversion: 2.20 time: 0.151882 Oct 19 13:35:47.916220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 89/172] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:47 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:48.666360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:48.667074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:48.672872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.673341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.673767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.674439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.674910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.675325 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.805024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:48.813942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6e445153-ca13-486c-b67a-3ef6afca3a9c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.151417 Oct 19 13:35:48.814684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 90/173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:48 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:48.941414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:48.942024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:48.948340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.948918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.949360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.950046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.950497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.950949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.085810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.094735 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.096172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.099918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e35f7f3d-386f-4345-bf88-10b098bdb832 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1597 microversion: 2.20 time: 0.160016 Oct 19 13:35:49.099918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 91/174] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:48 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:49.124617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:49.125076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:49.131515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.131978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.132500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.133090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.133533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.134052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.217109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3dc637d3-6a21-46ad-87a9-9da37c1abd7d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097379 Oct 19 13:35:49.217756 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 92/175] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 13:35:49 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:35:49.839475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:49.840397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:49.848185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.848864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.849525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.850562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.851112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.851632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.985670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-605e9132-811b-4569-a450-5aad713d9a74 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "POST /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.266833 Oct 19 13:35:49.992008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 84/176] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:35:43 2022] POST /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db/os-volume_attachments => generated 194 bytes in 6269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:35:50.182580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:50.191806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4f436fdc-b138-4738-bdbd-4e20878f157e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.358253 Oct 19 13:35:50.193016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 93/177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:49 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:50.721384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:35:50.735520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:50.736355 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:50.739403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:50.752429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] Creating event network-changed:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:35:50.758821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-62b33f16-af37-4dea-ad80-be282dcc9d04 req-55d55342-66c7-4250-9d32-c3f9b16ce064 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044903 Oct 19 13:35:50.760402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 85/178] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:35:51.215764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:51.217199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:51.223608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:51.224277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:51.224867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:51.225733 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:51.226325 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:51.226942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:51.232292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:51.619822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:51.627456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3f8a68f6-b982-4b78-960c-b3514aaca9a3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.415465 Oct 19 13:35:51.628878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 94/179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:51 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:52.651227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:52.651928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:52.658698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:52.659176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:52.659668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:52.660358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:52.660853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:52.661296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:52.814988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:52.827441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9a21e9f2-2608-4c55-b147-19d5bab4fefa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.180930 Oct 19 13:35:52.828036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 86/180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:52 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:53.850569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:53.851173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:53.857981 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.858455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.858905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.859578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.860026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.860442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.998343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:54.006047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-26e07a13-81dc-41cf-b4a5-89ee71ba10c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.159344 Oct 19 13:35:54.006632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 95/181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:53 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:55.029706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:55.030316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:55.036654 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.037133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.037561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.038241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.038720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.039138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.179221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:55.187173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-628362fd-d5a4-419d-a461-d2f260ec7ad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.161946 Oct 19 13:35:55.187751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 87/182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:55 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:56.209674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:56.210282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:56.217032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.217817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.218248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.218970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.219420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.219840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.360148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:56.367812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f5259f36-27bc-4fa5-89fe-d494398b6699 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.162079 Oct 19 13:35:56.368415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 96/183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:56 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:57.392700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:57.393549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:57.396134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=58 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:57.402123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.402636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.403071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.404030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.404525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.404952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.543454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:57.552992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5bb7f860-547e-4f24-b573-400ea2ed9b1f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.164691 Oct 19 13:35:57.559281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 88/184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:57 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:58.577087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:58.577704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:58.590342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:58.590342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:58.591197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:58.599761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:58.600357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:58.600860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:58.753928 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:58.761553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0e84ab70-662f-4446-b106-891ce00ef156 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.188360 Oct 19 13:35:58.762115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 97/185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:58 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:59.784296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:59.784923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:59.791427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.791910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.792389 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.793060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.793529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.794022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.925351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:59.933192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e1e12f8e-3286-431d-8b54-96a865cffe0e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.152682 Oct 19 13:35:59.933754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 89/186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:59 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:00.957939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:00.958485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:00.964417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.964894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.965327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:00.966054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.966531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.966991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:01.127793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:01.136263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2e29bdd0-8151-4897-9ee6-6de2a0b24855 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.182278 Oct 19 13:36:01.136822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 98/187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:00 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:02.159345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:02.159976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:02.166275 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.166778 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.167205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.167878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.168323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.168740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.294829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:02.302593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e293ed1d-0dd6-4be7-bcfe-a766be9e8c27 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.146980 Oct 19 13:36:02.303161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 90/188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:02 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:03.325697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:03.326998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:03.332973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.333447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.333873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.334578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.335027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.335442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.457799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:03.465368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-978e01cc-729f-4bfe-abf8-087b00883809 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.143425 Oct 19 13:36:03.465922 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 99/189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:03 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:04.488390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:04.488901 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:04.495254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.495726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.496153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:04.496826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.497273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.497689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:04.625543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:04.633075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fcd2bc94-bb20-47cc-a602-345ffee3b615 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148677 Oct 19 13:36:04.633635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 91/190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:04 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:05.655790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:05.656391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:05.662220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:05.662738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:05.663168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:05.663841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:05.664285 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:05.664696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:05.792837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:05.801189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-676cc45d-9858-4601-95b2-ba86ee2877ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.149595 Oct 19 13:36:05.801753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 100/191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:05 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:06.824085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:06.824695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:06.831198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.831681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.832114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.832802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.833259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.833686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.957637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:06.965247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7b6903d7-896d-4807-9172-c90c8929fd4d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.144989 Oct 19 13:36:06.965810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 92/192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:06 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:07.989702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:07.990746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:07.996782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.997254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.997681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:07.998874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.999328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.999743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:08.127615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:08.135820 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e12e76dd-2591-40fe-b007-5e577412b680 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.150369 Oct 19 13:36:08.136316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 101/193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:07 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:09.159438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:09.163569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:09.166437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.166947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.167376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.168057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.168507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.168929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.301463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:09.308985 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-81b7bd6a-d5ff-4eb6-b95e-58b51101ef36 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.153889 Oct 19 13:36:09.309622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 93/194] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:09 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:10.332081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:10.332694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:10.338724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.339199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.339625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.340309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.340758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.341177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.469946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:10.477602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ce3e2601-90d2-4975-b063-e2744a59fe7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.149374 Oct 19 13:36:10.478206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 102/195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:10 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:11.501169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:11.501868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:11.508237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:11.508716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:11.509150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:11.509832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:11.510285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:11.510735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:11.636903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:11.646924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-589f4d07-f520-41a8-b6bb-102f248e5446 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.149843 Oct 19 13:36:11.647740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 94/196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:11 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:12.671042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:12.671644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:12.677543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.678016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.678437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.679133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.679580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.680024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.807572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:12.816130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-782e46f0-95b3-4d3f-b8ee-33367170a772 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148921 Oct 19 13:36:12.816687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 103/197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:12 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:13.839438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:13.840042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:13.846923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.847392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.847819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.848492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.848937 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.849350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.864254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:13.976651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:13.984239 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-35731b90-b84b-478d-8683-be56e026e709 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148588 Oct 19 13:36:13.985416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 95/198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:13 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:15.008345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:15.008345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:15.014339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.014853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.015294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.015986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.016441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.016865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.146441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:15.152305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7d417eb1-4f7b-4889-8990-29b582d94692 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148501 Oct 19 13:36:15.152852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 104/199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:15 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:16.176153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:16.176758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:16.184416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.185143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.185577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.186256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.186745 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.187173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.323665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:16.331649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-834cf4ed-447c-43ab-b8c4-20d72a5ad46f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.159785 Oct 19 13:36:16.332200 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 96/200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:16 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:17.354489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:17.355132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:17.357036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=46 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:17.361635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.362108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.362569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:17.363254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.363706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.364124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:17.493229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:17.500786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-84f469ac-b5c9-405e-a046-be6927be5e32 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.150288 Oct 19 13:36:17.501343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 105/201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:17 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:18.396137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:18.396654 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:18.402820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.403290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.403717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.404395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.404841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.405259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.430412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:36:18.524519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:18.525131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:18.531201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.531621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.532055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.532744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.533865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.534294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.660027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-968209ec-5286-49d0-aa2b-88037fd11da4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 204 len: 0 microversion: 2.1 time: 0.267354 Oct 19 13:36:18.660621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 97/202] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:36:18 2022] DELETE /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:36:18.663749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.669099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:18.669903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:18.670184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8fc24997-abad-42ba-bd7d-07c9f7f62c2e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.149499 Oct 19 13:36:18.670771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 106/203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:18 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:18.676616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.677094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.677520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.678211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.678692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.679115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.811762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.820614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c673cecb-dc1a-4d36-8c6f-f8f3af012c14 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.155636 Oct 19 13:36:18.821175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 98/204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:18 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:19.693552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:19.694162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:19.708475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.708970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.709402 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.710271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.710758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.711183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.844384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:19.847012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:19.853714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.854365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.854833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.855522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.856023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.856589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.857177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.867893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-29be9130-932b-4c1a-b4ad-ba59bb1e2c7a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.178011 Oct 19 13:36:19.868551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 107/205] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:19 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:19.990608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.998751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6d0d0657-befa-4166-a238-28cb9a3bcbb2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.158182 Oct 19 13:36:19.999329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 99/206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:19 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:20.890107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:20.890877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:20.896780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:20.897255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:20.897685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:20.898372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:20.898857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:20.899279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.024298 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:21.025864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:21.028180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.032374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.032861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.034125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.035002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.035607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.036360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0215d995-dc22-4617-8fc1-b1971a1eee8e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.150013 Oct 19 13:36:21.036489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.036938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 108/207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:20 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:21.168931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.177766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d5a57fcd-0150-4651-8c85-e05b5c15fd79 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.159703 Oct 19 13:36:21.178357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 100/208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:21 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:22.058694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:22.059298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:22.065894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.066366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.066816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.067490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.067936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.068348 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.202785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:22.203401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:22.203712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.210312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.210825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.211264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.212097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.212399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c2f301fc-40ab-4f0c-8f6e-12736fc9d154 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.157362 Oct 19 13:36:22.212551 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.213137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 109/209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:22 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:22.213274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.345893 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.354180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-83a7d639-a20e-413c-82f7-3551a27d51e0 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.156852 Oct 19 13:36:22.354769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 101/210] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:22 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:23.236427 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:23.237037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:23.243069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.243557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.243988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.244684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.245241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.245668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.379279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:23.379961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:23.384723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:23.386957 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.387545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.388034 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.388222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:23.389148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.389667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.390177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.393469 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-59753352-a524-4c20-9803-e81fd07b5303 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.160948 Oct 19 13:36:23.394192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 110/211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:23 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:23.527277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:23.535624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5671b905-3576-4bed-b19d-5111878245e2 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.161685 Oct 19 13:36:23.536367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 102/212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:23 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:24.417916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:24.418538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:24.425480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.425958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.426387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.427097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.427545 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.427958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.766961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.768228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:24.768228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:24.768679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9abb3228-bda2-41c9-ad1c-106a9307b399 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.149963 Oct 19 13:36:24.768679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 111/213] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:24 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:24.768843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.768843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.768843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.768843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.769164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.769164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.769164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.769405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6539aed6-9df5-4ecd-b3b9-87dacb8cb72b tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.150607 Oct 19 13:36:24.769405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 103/214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:24 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:25.586399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:25.587063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:25.592881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.593352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.593777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.594454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.594925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.595854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.721653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.729365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ed471ceb-be9c-4d4f-999e-8fdeb887aef1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.146776 Oct 19 13:36:25.729536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:25.729929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 112/215] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:25 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:25.730078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:25.736800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.737270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.737703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.738375 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.738851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.739269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.869233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.878409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b479340d-bac9-45b5-a3bf-59a98bd75597 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.152768 Oct 19 13:36:25.878994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 104/216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:25 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:26.753141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:26.753749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:26.759800 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.760281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.760714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.761400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.761852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.762276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.889808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:26.897500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8ba0a13e-5283-4d30-af4f-8d5a50a70f21 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148799 Oct 19 13:36:26.898061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 113/217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:26 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:26.901228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:26.901941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:26.908413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.910119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.910119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.910119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.910535 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.910954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.037910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:27.053409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-25940519-522a-4245-afbb-e93b7d6d1537 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.149073 Oct 19 13:36:27.053409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 105/218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:26 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:27.920356 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:27.920967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:27.927506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.927987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.928423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.929110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.929573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.929990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.057307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.063641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bc121a04-4ac4-445c-bfc7-8f6ac535c7ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.147141 Oct 19 13:36:28.064207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 114/219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:27 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:28.069210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:28.069818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:28.072207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:28.077331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.077984 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.078618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.079302 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.079838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.080258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.210765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.218927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e4439221-d50d-4cf6-98ec-b3f7333298bc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.153561 Oct 19 13:36:28.219497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 106/220] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:28 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:29.086342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:29.087025 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:29.092888 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.093366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.093798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.094479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.094956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.095378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.223477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.231001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6f22157d-e9da-4e32-9261-024d6b07fc3f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.148498 Oct 19 13:36:29.231558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 115/221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:29 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:29.242737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:29.243351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:29.249684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.250164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.250640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.251325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.252493 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.252929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.379779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.387986 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0041b33f-7bfa-4f26-bce0-2b83ec5b8723 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.149118 Oct 19 13:36:29.388547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 107/222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:29 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:30.254340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:30.254981 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:30.261051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.261530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.261955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:30.262654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.263105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.263519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:30.389241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:30.397430 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-afa7f969-dea6-4284-ba96-ae3348536363 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.147361 Oct 19 13:36:30.397987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 116/223] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:30 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:30.410132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:30.410764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:30.416805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.417281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.417739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:30.418553 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.419009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.419428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:30.553615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:30.562832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6f294efb-38f5-462f-a5b9-e7b8414b7bcc tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1552 microversion: 2.1 time: 0.156457 Oct 19 13:36:30.563402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 108/224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:30 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:31.428134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:31.428808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:31.435109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.435672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.436168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.436915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.437450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.438091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.573271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.581466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d5a4f4a9-3559-49f5-96f5-7101a417d907 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.157462 Oct 19 13:36:31.582038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 117/225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:31 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:31.599338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:31.600030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:31.606408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.607191 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.607713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.608464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.608983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.609471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.652771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6206e4-6de7-4933-bfb2-2a39c28f56db", "name": "network-vif-deleted", "tag": "9c36380a-941f-4089-ba11-68e2dee4d597"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:31.663574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.664259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.664688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.676685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] Creating event network-vif-deleted:9c36380a-941f-4089-ba11-68e2dee4d597 for instance fb6206e4-6de7-4933-bfb2-2a39c28f56db on hv-cinder-86188 Oct 19 13:36:31.677821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.681737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-d954e465-50da-4fee-9fcb-f4af2b8a397e req-0f9a18a9-322e-4494-b11d-0639ef72f7fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Oct 19 13:36:31.682707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 118/226] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:36:31.690861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f3706505-6c03-48a2-9a14-dd9fdb8f6360 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1510 microversion: 2.1 time: 0.099308 Oct 19 13:36:31.691448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 109/227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:31 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1510 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:32.604907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:32.605801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:32.612528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.613015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.613479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.614276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.614758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.615181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.714890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:32.716193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:32.723014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.723497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.723927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.724776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.725799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.725799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.744464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:32.749516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.766602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f7888c62-9f52-42b2-b75a-b8e7091cb7df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.160066 Oct 19 13:36:32.766602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 119/228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:32 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:32.794414 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.805113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-32a04ed4-2825-4410-b3d6-09578487c180 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1345 microversion: 2.1 time: 0.093634 Oct 19 13:36:32.805113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 110/229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:32 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:33.787880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:33.788577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:33.794786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.801519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.801519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.801519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.801519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.802106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.831938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:33.833079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:33.840543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.841822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.842429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.843341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.843968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.844393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.909481 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.917986 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-09ed4a08-4397-4844-914d-e316b324fd87 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1345 microversion: 2.1 time: 0.093088 Oct 19 13:36:33.934203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 111/230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:33 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:33.963006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.971120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-351b6354-13fb-436e-9a54-5b436a23c986 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.187172 Oct 19 13:36:33.975303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 120/231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:33 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:34.941624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:34.942254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:34.949301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.953141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.953141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.953141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.953141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.953561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.984546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.984928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.985357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.985810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lazy-loading 'fault' on Instance uuid fb6206e4-6de7-4933-bfb2-2a39c28f56db {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:36:34.995581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:34.996718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:35.003801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.004604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.005201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.006224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.006861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.007966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.055006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8665d60741af4d96a3ceb8f59ff458bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49e667714043b9a821ac5c0b8b3663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.064638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bedcbed3-874c-4ac6-a903-f243e2bcab83 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 200 len: 1350 microversion: 2.1 time: 0.127129 Oct 19 13:36:35.065200 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 112/232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:34 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:35.156880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.165528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3a6478ab-0be3-4f00-9f67-913bbdc377c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.173718 Oct 19 13:36:35.166095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 121/233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:34 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:36.089337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:36.089947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:36.109087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.109087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.109087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.109087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.109415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.109415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.116174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] HTTP exception thrown: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Request method failure captured: Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db HTTP/1.1 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z9KM0jwEz4Aq5PT1cUDsvXeDatsiH3CzRTOQpfHTOPNHrADACy8pktMotFE0qgHaKOA8zuYjdqGDsmvTzYDTQctULWoJEYpLhjdk2s8qOlz8yWGEDoIUBlZSwCdHuAyr6VNqrP-xdPCpjat3RfYR15Gp-dvgw-jsjUiDd4H1D3tws Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:36:36.121374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1a49e667714043b9a821ac5c0b8b3663", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 8665d60741af4d96a3ceb8f59ff458bb Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.122891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'fb6206e4-6de7-4933-bfb2-2a39c28f56db'} Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:36:36.123959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.125541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.127632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Returning 404 to user: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:36:36.127632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-011abf1d-2ff2-4bd8-8974-7f66bdc8e96d tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 404 len: 111 microversion: 2.1 time: 0.037497 Oct 19 13:36:36.127632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 113/234] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:36 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:36:36.193331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:36.194093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:36.200821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.201357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.201846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.202745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.203375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.203626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.247112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:36.249363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:36.256013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.256499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.256933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.257618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.258070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.258490 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.272743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] HTTP exception thrown: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Request method failure captured: Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db/os-volume_attachments HTTP/1.1 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z9KM0jwEz4Aq5PT1cUDsvXeDatsiH3CzRTOQpfHTOPNHrADACy8pktMotFE0qgHaKOA8zuYjdqGDsmvTzYDTQctULWoJEYpLhjdk2s8qOlz8yWGEDoIUBlZSwCdHuAyr6VNqrP-xdPCpjat3RfYR15Gp-dvgw-jsjUiDd4H1D3tws Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:36:36.274542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1a49e667714043b9a821ac5c0b8b3663", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 8665d60741af4d96a3ceb8f59ff458bb Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.275972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'server_id': 'fb6206e4-6de7-4933-bfb2-2a39c28f56db'} Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:36:36.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:36.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:36.279552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Returning 404 to user: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:36:36.279552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-73a1cebd-b2b9-4212-809f-7cc038747823 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032873 Oct 19 13:36:36.279552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 114/235] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:36:36 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:36:36.382717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:36.391963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e8c8dd98-4a2a-43d9-940a-66fe21b771a6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.206315 Oct 19 13:36:36.394807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 122/236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:36 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:37.415460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:37.416211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:37.422485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:37.422996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:37.423428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:37.424128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:37.424578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:37.424995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:37.617925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:37.625648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a1e3324b-e388-4deb-831e-1f75f51f3243 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.214044 Oct 19 13:36:37.626215 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 115/237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:37 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:38.649251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:38.649866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:38.655680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.656162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.656609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.657311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.657760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.658852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.813547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:38.825080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f843fab0-3a55-4c18-bac8-154b3e8759a0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.179596 Oct 19 13:36:38.825846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 123/238] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:38 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:39.849626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:39.850569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:39.857289 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.861929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.861929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:39.861929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.861929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.862293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.014386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:40.022653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6e530253-e4e6-4f8b-975e-aaf30d2f86cb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.177809 Oct 19 13:36:40.023228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 116/239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:39 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:40.826886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:40.827439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:40.835068 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.835548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.835973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.846623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.846623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.846623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.850869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] HTTP exception thrown: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Request method failure captured: Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db HTTP/1.1 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z9KM0jwEz4Aq5PT1cUDsvXeDatsiH3CzRTOQpfHTOPNHrADACy8pktMotFE0qgHaKOA8zuYjdqGDsmvTzYDTQctULWoJEYpLhjdk2s8qOlz8yWGEDoIUBlZSwCdHuAyr6VNqrP-xdPCpjat3RfYR15Gp-dvgw-jsjUiDd4H1D3tws Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:36:40.855635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1a49e667714043b9a821ac5c0b8b3663", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 8665d60741af4d96a3ceb8f59ff458bb Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.857042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'fb6206e4-6de7-4933-bfb2-2a39c28f56db'} Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:36:40.857955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.859143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.860281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Returning 404 to user: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:36:40.860281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0256aa99-d003-4e19-a590-d01968e68ef4 tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 404 len: 111 microversion: 2.1 time: 0.033941 Oct 19 13:36:40.860281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 124/240] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:36:40 2022] DELETE /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:36:40.865527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:40.866526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] [instance: fb6206e4-6de7-4933-bfb2-2a39c28f56db] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:40.872709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.873220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.873666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.874363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.874844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.875275 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.889847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] HTTP exception thrown: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Request method failure captured: Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db HTTP/1.1 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z9KM0jwEz4Aq5PT1cUDsvXeDatsiH3CzRTOQpfHTOPNHrADACy8pktMotFE0qgHaKOA8zuYjdqGDsmvTzYDTQctULWoJEYpLhjdk2s8qOlz8yWGEDoIUBlZSwCdHuAyr6VNqrP-xdPCpjat3RfYR15Gp-dvgw-jsjUiDd4H1D3tws Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:36:40.891628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1a49e667714043b9a821ac5c0b8b3663", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a49e667714043b9a821ac5c0b8b3663"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 1a49e667714043b9a821ac5c0b8b3663 Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-DeleteServersTestJSON-2135559275 Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 8665d60741af4d96a3ceb8f59ff458bb Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-DeleteServersTestJSON-2135559275-project Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.893651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'fb6206e4-6de7-4933-bfb2-2a39c28f56db'} Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:36:40.894586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. Oct 19 13:36:40.896332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:36:40.897794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] Returning 404 to user: Instance fb6206e4-6de7-4933-bfb2-2a39c28f56db could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:36:40.897794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-92d6d2e3-b891-47dd-99f9-7b736f1a479c tempest-DeleteServersTestJSON-2135559275 tempest-DeleteServersTestJSON-2135559275-project] 10.222.0.39 "GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db" status: 404 len: 111 microversion: 2.1 time: 0.032254 Oct 19 13:36:40.897794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 117/241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:40 2022] GET /compute/v2.1/servers/fb6206e4-6de7-4933-bfb2-2a39c28f56db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:36:41.047221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:41.048015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:41.062084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.066900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.067643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.068786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.069441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.070314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.528887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:41.536432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1f6fb297-4328-4c8f-81cb-0458193d581f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.494131 Oct 19 13:36:41.536987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 125/242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:41 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:42.559813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:42.560424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:42.568139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.569116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.571652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.571652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.571652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.571652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.799383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:42.812463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-91b2d3fa-e198-41dc-b514-a1ce37b84fa5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.257530 Oct 19 13:36:42.827572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 118/243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:42 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:43.842222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:43.843661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:43.866605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.880506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.882600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:43.884700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.885357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.887218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:44.126168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:44.142383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-afa75f85-d496-4621-a475-69ba67d14eab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.302587 Oct 19 13:36:44.145205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 126/244] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:43 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:45.172796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:45.173505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:45.183664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.184456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.184882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.185597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.191947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.192400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.419182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:45.427867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8da27ef0-01de-4fe6-860b-7e598d5f9537 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.260366 Oct 19 13:36:45.428372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 119/245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:45 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:46.453613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:46.455952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:46.467790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.468389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.469478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.470815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.472471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.473132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.608394 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:46.617864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c8fb704b-e670-4616-aadc-da373bca2db5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1519 microversion: 2.1 time: 0.169531 Oct 19 13:36:46.618830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 127/246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:46 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:47.640603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:47.641211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:47.648215 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.648698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.649132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.649812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.650272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.655419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.781145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.789123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ac52ff19-3c2d-4355-b2d7-29afdff4996a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1499 microversion: 2.1 time: 0.152349 Oct 19 13:36:47.789696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 120/247] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:47 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:47.812757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:47.813419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:47.816046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=46 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:47.820783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.822169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.822169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.822467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.822943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.823400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.961422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.964791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:47.969308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e81424cb-ed87-42a4-bb21-7d07a80a093f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1515 microversion: 2.1 time: 0.160808 Oct 19 13:36:47.969867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 128/248] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:47 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:50.833709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:50.835892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:50.842364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:50.842918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:50.843412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:50.844112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:50.844545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:50.844965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:50.868741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'flavor' on Instance uuid 999a9976-a51e-4933-8342-5c862b9a574a {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:36:51.235908 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7fc2b9f8-c26e-4e02-a623-c2a73e84d643 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/action" status: 200 len: 32 microversion: 2.1 time: 0.406154 Oct 19 13:36:51.238057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 121/249] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:36:50 2022] POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:36:51.247432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:51.250924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:51.262441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.264014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.264678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.265388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.265853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.266282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.411379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:51.423558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e0dcff07-3f9e-4893-ac86-5f0cc8b0184f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.177652 Oct 19 13:36:51.423558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 129/250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:51 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:52.445619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:52.446390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:52.453716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.454199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.454656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.456921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.456921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.456921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.663254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:52.671744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a4e418da-ee5a-416f-974a-87fa44ea0f79 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.230301 Oct 19 13:36:52.672331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 122/251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:52 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:53.695552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:53.696162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:53.702295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.702809 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.705654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.705654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.705654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.705654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.849822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:53.857742 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bd4b4be4-204f-43b3-a413-cf417f9c06ee tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.166176 Oct 19 13:36:53.858310 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 130/252] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:53 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:54.881658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:54.882539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:54.889558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:54.890044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:54.891464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:54.892039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:54.892631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:54.893565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.039996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:55.047811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dba4473d-20ce-462b-abe1-362b89ed29e0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.169921 Oct 19 13:36:55.054940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 123/253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:54 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:56.078966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:56.079606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:56.087074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:56.087553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:56.088186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.088877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:56.089324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:56.089739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.250482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:56.258723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2d41c8dd-f693-4ef0-995e-d7cd932e4f62 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.183426 Oct 19 13:36:56.259534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 131/254] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:56 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:57.283230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.284010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.293262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.293758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.294198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.294924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.295730 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.297582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.439977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:57.448630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2f2a14e8-ce07-4152-ab53-f3fc9e5fc4c8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.169710 Oct 19 13:36:57.449223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 124/255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:57 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:58.471713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:58.472316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:58.478335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.478889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.479318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.480210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.480662 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.481076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.663717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.677170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e483f68f-0412-4d28-9dbb-5db07417404c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.209843 Oct 19 13:36:58.691132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 132/256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:58 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:59.704499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:59.705688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:59.708452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=40 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:59.713090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.713580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.714019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.714802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.715262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.715688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.983146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:59.990722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6269ab57-d746-402b-8b4e-cc351f346576 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.290827 Oct 19 13:36:59.991545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 125/257] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:59 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:01.015299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:01.015299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:01.022976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.023496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.023934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:01.024668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.025125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.025548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:01.159094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:01.167812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ba06beea-7904-44c1-ab3a-6529169d6625 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.158074 Oct 19 13:37:01.168374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 133/258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:01 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:02.190552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:02.191082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:02.197968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:02.198452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:02.198912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:02.199596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:02.200047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:02.200465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:02.326776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:02.329095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:02.335166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f6bed6e4-9fa5-4223-b32a-70922894f33a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.148526 Oct 19 13:37:02.335775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 126/259] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:02 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:02.712454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-125087159", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "networks": [{"uuid": "eef2f5bd-2917-45dc-a8f9-9058fd771b27"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:02.765737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] validate_networks() for [('eef2f5bd-2917-45dc-a8f9-9058fd771b27', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:37:03.111257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:37:03.111680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:37:03.112150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:37:03.112621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:37:03.113064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:37:03.122552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.123020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.123451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.124170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.124619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.125047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.141304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Getting quotas for project 62fb03abd1f64d748b132fa450f641f8. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:37:03.148398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Getting quotas for user b69eb168c92343b5819d4795eb85dd7a and project 62fb03abd1f64d748b132fa450f641f8. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:37:03.156388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:37:03.158700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:37:03.306138 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-401d38c8-a856-4a66-87bb-fa8e5dac195c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597640 Oct 19 13:37:03.309340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 134/260] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:37:03.318103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-32b5b56d-6c77-484d-8c47-378c4016c94c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:03.318840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-32b5b56d-6c77-484d-8c47-378c4016c94c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:03.358160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:03.358788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:03.364977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.365489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.365926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.366866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.367336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.367924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.378158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-32b5b56d-6c77-484d-8c47-378c4016c94c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:03.385907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-32b5b56d-6c77-484d-8c47-378c4016c94c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1213 microversion: 2.1 time: 0.071479 Oct 19 13:37:03.390842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 127/261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:03 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:03.512260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:03.520017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a77c7cb8-77b3-4736-ae16-25cce8feb6c2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.165745 Oct 19 13:37:03.521134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 135/262] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:03 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:04.409123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:04.409736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:04.418689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.419296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.419728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.420416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.420862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.421421 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.482253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.490716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-06392d73-f1a7-458c-9df8-58c2269ebf16 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1217 microversion: 2.1 time: 0.085337 Oct 19 13:37:04.491278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 128/263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:04 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:04.543015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:04.543631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:04.549437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.555272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.555272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.555272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.555272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.555679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.687711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.695901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cc586b61-09cb-4804-9dfa-48f5d0d9292e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.156503 Oct 19 13:37:04.696553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 136/264] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:04 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:05.512941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:05.513677 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:05.521171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.521650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.522080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.528279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.528279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.528279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.592141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.593362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2ee7941e-0d42-4b29-85b0-701620a52efe tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1217 microversion: 2.1 time: 0.084245 Oct 19 13:37:05.593915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 129/265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:05 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:05.719446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:05.720114 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:05.725893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.726373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.726858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.727535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.727980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.728399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.858688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.867533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8874ecea-6049-43bf-82ae-a467ad31bd6b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.152072 Oct 19 13:37:05.868573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 137/266] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:05 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:06.617107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:06.623526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:06.624334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.624812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.625248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.626121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.626798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.627231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.687256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:06.695742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-78d64361-63fb-4a4e-b247-4e0d4e11ba8f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1217 microversion: 2.1 time: 0.083065 Oct 19 13:37:06.696300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 130/267] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:06 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:06.891344 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:06.892807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:06.898271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.898825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.899252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.899937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.900389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.900804 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.047131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.055644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-96a801a4-b628-4e62-b8ec-8731a7e72ef5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.168144 Oct 19 13:37:07.056201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 138/268] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:06 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:07.718416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:07.719071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:07.725501 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.725985 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.726465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.727235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.727694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.728116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.791190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.798827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-36b9a3d6-b18d-48ff-b961-9a6bcf686b35 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1217 microversion: 2.1 time: 0.085227 Oct 19 13:37:07.799381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 131/269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:07 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:08.078162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:08.079347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:08.085350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.085832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.086266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.087075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.087422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.087844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.218762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:08.226900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-681fa4f2-c957-4292-aabb-4e61f99cef7d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.152485 Oct 19 13:37:08.227471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 139/270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:08 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:08.821969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:08.822606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:08.828960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.830076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.830544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.831246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.831766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.832350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.896370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:08.905125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5de1c188-60c3-4f2c-8c5b-90d976fb319f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1217 microversion: 2.1 time: 0.086954 Oct 19 13:37:08.906263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 132/271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:08 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:09.250465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:09.251164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:09.258310 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:09.258836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:09.259266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:09.259978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:09.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:09.260885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:09.389370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:09.397126 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2d7a6834-4f54-49f7-837d-b1b52f41eed7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.150483 Oct 19 13:37:09.397695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 140/272] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:09 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:09.929525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:09.930145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:09.937029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:09.937694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:09.938156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:09.938878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:09.939336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:09.940505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.004129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:10.011956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2846519c-87df-45b6-9213-ec585788ba45 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1265 microversion: 2.1 time: 0.086989 Oct 19 13:37:10.012761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 133/273] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:09 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:10.119832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-710508524", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "networks": [{"uuid": "f3a65e36-8a53-4746-84eb-5af871f9374d"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:10.174096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] validate_networks() for [('f3a65e36-8a53-4746-84eb-5af871f9374d', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:37:10.419974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:10.420596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:10.426427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.426944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.427917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.428244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.428689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.429280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.550835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:37:10.551853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:37:10.552494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:37:10.553055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:37:10.553501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:37:10.563505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.563985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.564421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.565224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.565996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.566420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.589863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Getting quotas for project c20b3147c0d14452b9c5f22801c89990. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:37:10.593975 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Getting quotas for user eb7a8349031b4f87a4f477e4a4e6ba2b and project c20b3147c0d14452b9c5f22801c89990. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:37:10.605218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:37:10.607416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:37:10.612575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:10.620976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-50ec2e4e-da75-42a2-997a-dc9976e71d45 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.204822 Oct 19 13:37:10.621915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 134/274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:10 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:10.718830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-248cb93a-f8c6-4399-9207-ff0b6a3d908c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602710 Oct 19 13:37:10.720745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 141/275] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:37:10.731344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-21617fa9-1f19-4b9e-b9f8-48c65dbe9b5e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:10.732476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-21617fa9-1f19-4b9e-b9f8-48c65dbe9b5e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:10.805008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-21617fa9-1f19-4b9e-b9f8-48c65dbe9b5e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:10.812036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-21617fa9-1f19-4b9e-b9f8-48c65dbe9b5e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1218 microversion: 2.1 time: 0.084735 Oct 19 13:37:10.812807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 135/276] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:10 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:11.035841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:11.036519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.042661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.043147 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.043613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.044311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.044760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.045184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.107204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:11.115844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-96e92fa8-47b2-4752-ba76-0d275649ba63 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1265 microversion: 2.1 time: 0.084027 Oct 19 13:37:11.116417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 142/277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:11 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:11.649477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:11.650008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.656979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.657972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.657972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.658706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.659168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.659598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.837669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:11.838363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.849989 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.852767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.853432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.856085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.856635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.863105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.878755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:11.886482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-74fa5101-ab28-4b52-9096-423f7446e5d2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1501 microversion: 2.1 time: 0.242268 Oct 19 13:37:11.903080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 136/278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:11 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:11.912959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "649a99d0-fa59-497d-9322-f1c9a2e12288"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:11.916486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.923796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.924382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.924864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.925574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.926047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.926547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.960698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] HTTP exception thrown: Cannot 'attach_volume' instance 999a9976-a51e-4933-8342-5c862b9a574a while it is in vm_state rescued Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Request method failure captured: Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/os-volume_attachments HTTP/1.1 Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 74 Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z97DcIsQ_Yj_t4gqBEsR_6QQ5NQGSvnfsgsIEqGGOwz-DvZRcPl-dL3hmg4HvhX1KuS3sK5aMUlDU0_ucx7mh4jVyXq71WamPFZfjfieG1gx_fRs4LuobUsUPdtmqs0btq5sTPb6OcZF-OKmGq51PcAhwFzMghs9YDmdYduQbqOwA Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:37:11.962410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3e2936fe3344e60b6f3dc918b9c738e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 020ff888a8a44d2eb6961829407637a9 Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {"volumeAttachment": {"volumeId": "649a99d0-fa59-497d-9322-f1c9a2e12288"}} Oct 19 13:37:11.963704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Cannot 'attach_volume' instance 999a9976-a51e-4933-8342-5c862b9a574a while it is in vm_state rescued Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'server_id': '999a9976-a51e-4933-8342-5c862b9a574a', 'body': {'volumeAttachment': {'volumeId': '649a99d0-fa59-497d-9322-f1c9a2e12288'}}} Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 999a9976-a51e-4933-8342-5c862b9a574a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:37:11.964422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 999a9976-a51e-4933-8342-5c862b9a574a while it is in vm_state rescued Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:37:11.966109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 999a9976-a51e-4933-8342-5c862b9a574a while it is in vm_state rescued Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Returning 409 to user: Cannot 'attach_volume' instance 999a9976-a51e-4933-8342-5c862b9a574a while it is in vm_state rescued {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6ee1b8ba-cbe7-44dd-8e88-236e3a2feca6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057000 Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 137/279] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:37:11 2022] POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 13:37:11.974928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:11.975716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.980568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.981097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.981543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.982235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.983132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.983723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.984895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:11.993881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b1719fee-e37d-41c3-b211-64d60e49486e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1222 microversion: 2.1 time: 0.161712 Oct 19 13:37:11.995903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 143/280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:11 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:12.140380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:12.141106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:12.147973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.148747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.149503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.150272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.150752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.151410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.232510 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:12.241448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9ade5bc0-39d8-4025-9f8e-41f991e13faf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1271 microversion: 2.1 time: 0.106376 Oct 19 13:37:12.242053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 144/281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:12 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:12.314281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-12796c58-db31-4076-9d64-8a7a342001b4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/action" status: 202 len: 0 microversion: 2.1 time: 0.344739 Oct 19 13:37:12.315264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 138/282] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:37:11 2022] POST /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:37:12.326392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:12.327256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:12.333511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.334298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.335613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.336254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.336708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.337132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.494304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:12.513118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9ba6e20f-9d7e-49df-8c64-a1ea7f580a25 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1509 microversion: 2.1 time: 0.191211 Oct 19 13:37:12.514153 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 145/283] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:12 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:13.021998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:13.022850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:13.029787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.030276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.030735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.031424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.031874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.032294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.170669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:13.178895 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2a671b3a-1cda-4ce1-8ab2-ef236924e495 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1270 microversion: 2.1 time: 0.161062 Oct 19 13:37:13.179378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 139/284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:13 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:13.268117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:13.268848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:13.275834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.276332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.276771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.277483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.277999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.278566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.421622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:13.425550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:13.431096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4c5650ec-685d-47a4-91c3-574cbb02ca91 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.167234 Oct 19 13:37:13.432349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 146/285] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:13 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:13.537487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:13.538095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:13.545502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.546164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.546619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.547505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.547961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.548383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.854727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:13.862819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8dceef46-1861-4934-a4ec-4b5a6492d878 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1509 microversion: 2.1 time: 0.329969 Oct 19 13:37:13.864476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 140/286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:13 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:14.203321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:14.203992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:14.211576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.212297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.212897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.213582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.214177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.214777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.277680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:14.298697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1e1f958c-9e0e-4856-81cf-0dd1a624ab0e tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1276 microversion: 2.1 time: 0.086391 Oct 19 13:37:14.298697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 147/287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:14 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:14.373520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4dc753-63e8-43c0-80ba-48b9f0237919", "tag": "b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:14.383487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.383977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.384399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.396186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] Creating event network-changed:b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77 for instance aa4dc753-63e8-43c0-80ba-48b9f0237919 on hv-cinder-86188 Oct 19 13:37:14.401221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-5ca1a6d2-5368-4da3-846a-8c13afe849bf req-9e07f010-8537-4d2b-8b48-89802d7866e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031588 Oct 19 13:37:14.401980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 141/288] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:14.459617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:14.460354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:14.466190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.466830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.467437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.468197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.468720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.469221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.619231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:14.627212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-887206c6-cb6f-4cb8-993b-0e7ec07d1af1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.171813 Oct 19 13:37:14.627770 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 148/289] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:14 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:14.887430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:14.888124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:14.894419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.895494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.895927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.896601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.897049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.897469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.033555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:15.041774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-578fe5c5-03b0-4fd2-9192-6b962ced7314 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1509 microversion: 2.1 time: 0.158479 Oct 19 13:37:15.042319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 142/290] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:14 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:15.308962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:15.309574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:15.315470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:15.315951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:15.316383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.317072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:15.317535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:15.317943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.449626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:15.457840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0ca2f40f-9196-4d71-9bca-7b87aa2a0d68 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.152419 Oct 19 13:37:15.458390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 149/291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:15 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:15.650774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:15.651453 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:15.658119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:15.658964 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:15.659417 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.660084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:15.661157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:15.661579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.799867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:15.807810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fb8cf159-a9b2-495e-8d85-5f8aea29b4a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.161101 Oct 19 13:37:15.820303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 143/292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:15 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:16.065429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:16.066212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:16.072764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.073185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.073619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.074297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.074776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.075194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.202309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:16.210732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-744a79f5-6728-487e-bf02-4da183dda0ca tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1509 microversion: 2.1 time: 0.148815 Oct 19 13:37:16.211380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 150/293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:16 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:16.480425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:16.481240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:16.488631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.489703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.490238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.491272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.491795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.492603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.846080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:16.853085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:16.867575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.869964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.870534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.871276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.871732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.875023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.891673 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:16.904284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c00dcfc1-c7df-4792-88f5-719b4fdf9c95 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.428020 Oct 19 13:37:16.905725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 144/294] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:16 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:17.122019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:17.122019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4c5e3172-2109-4ccf-96d5-372e00de4d2f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.283880 Oct 19 13:37:17.122019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 151/295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:16 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:17.233890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:17.234890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:17.244135 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.244514 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.244955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:17.245816 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.246391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.246873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:17.264360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:17.875302 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:17.884329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5461253b-3ef2-4f0b-b97f-98b8bc136e84 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1509 microversion: 2.1 time: 0.654675 Oct 19 13:37:17.885164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 145/296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:17 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:17.929602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:17.930256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:17.936373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.936853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.937277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:17.938021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.938472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.939028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.075032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:18.083290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a3ee131a-5085-491a-a03a-a0824cd6c5a5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.157979 Oct 19 13:37:18.083854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 152/297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:17 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:18.147541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:18.147541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:18.153609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.154107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.154829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.156025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.158894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.159365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.239586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df539f7-e7db-4b11-9e94-8ae295de3eb9", "tag": "32fdbcaa-a79c-4f91-82aa-12d9415a3d90"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:18.250292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.251081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.252277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.275259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] Creating event network-changed:32fdbcaa-a79c-4f91-82aa-12d9415a3d90 for instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 on hv-cinder-86188 Oct 19 13:37:18.276997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-6a583ebb-a1f5-4a1a-921c-c0ba0424d5ec req-d50fecaa-8197-45cd-818d-163c159a91b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042319 Oct 19 13:37:18.278154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 153/298] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:18.529136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:18.537555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-03f950c6-1f77-4c86-a621-6ad6d152b7b3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.396157 Oct 19 13:37:18.538207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 146/299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:18 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:18.908995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:18.909694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:18.916213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.916698 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.917130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.917899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.918356 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.918839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.091281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:19.098914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-24e3d276-6496-4bad-bd98-b6584f5c097a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1515 microversion: 2.1 time: 0.194187 Oct 19 13:37:19.099476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 154/300] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:18 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:19.108103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:19.109158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:19.116619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.117130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.117573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.118292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.118781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.119538 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.271170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:19.280976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9e840b84-231e-41e7-8a37-c307300a2ad0 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.177503 Oct 19 13:37:19.282001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 147/301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:19 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:19.560952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:19.561893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:19.569490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.569968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.570400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.571115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.571619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.572065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.719798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:19.732241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-35693222-0617-4d06-85ab-daddb1576de2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.175493 Oct 19 13:37:19.733003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 155/302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:19 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:20.308132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:20.309197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:20.315621 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:20.316101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:20.316532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:20.317251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:20.317697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:20.318120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:20.503144 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:20.510831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5406f24e-c637-482d-942c-4a0e8319bb9b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.206618 Oct 19 13:37:20.511395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 148/303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:20 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:20.755240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:20.755870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:20.757937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:20.758736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=12 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:20.764438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:20.764815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:20.765622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:20.767854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:20.767854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:20.767854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:20.910291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:20.918902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c4a7afc0-35b6-40ea-b68e-52a4591109a7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.167433 Oct 19 13:37:20.919472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 156/304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:20 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:21.534170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:21.534736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:21.536628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=4 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:21.541911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.542422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.542878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.543575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.544038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.544460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.675465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:21.683882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4b0fc680-fafc-4146-9a97-9e642d7f0680 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.153908 Oct 19 13:37:21.684521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 149/305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:21 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:21.930797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ce7d1fa7-0fd7-4ca5-9810-c0bef07ec604 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: .version_select at 0x7fb41e5feaf0>, body: {"keypair": {"name": "tempest-keypair-575202321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdNF9hBp15Et3m6l3DR/X75Ope8kWFTrVD6ZRKyRCJaBdle0xtJ6exRWQt2xyUFeFcqP0acGIii+Ae4qHglax3uChRCxDOtA3nFQlxiT60eDRJoIj/6osPbg9ipq2FiSg=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:21.938942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:21.941242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:21.941833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:21.949597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.950426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.951015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.951659 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-ce7d1fa7-0fd7-4ca5-9810-c0bef07ec604 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:37:21.951774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.952189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.952723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.956920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-ce7d1fa7-0fd7-4ca5-9810-c0bef07ec604 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for user 020ff888a8a44d2eb6961829407637a9 and project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:37:22.042193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ce7d1fa7-0fd7-4ca5-9810-c0bef07ec604 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115237 Oct 19 13:37:22.047825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 157/306] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:37:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:22.105766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:22.114700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aa392159-af11-418f-813e-8e48e2685417 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.176789 Oct 19 13:37:22.115265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 150/307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:21 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:22.708533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:22.709431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:22.723143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:22.723143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:22.723143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:22.723143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:22.724334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:22.724334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:22.859936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:22.867776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d358d931-62c3-43f8-b234-3afc7abef779 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.164349 Oct 19 13:37:22.868331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 158/308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:22 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:23.137315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:23.137972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:23.144358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.144841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.145773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:23.146450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.147011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.147440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:23.295498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:23.303291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7523ec45-3e98-480b-aa0b-fc35a1f53b25 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.169945 Oct 19 13:37:23.303846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 151/309] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:23 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:23.891403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:23.892079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:23.898812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.899298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.899919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:23.900622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.901248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.901830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:24.085231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:24.092743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0eab05d2-39c9-490e-8bf2-501ce74f76f6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.205651 Oct 19 13:37:24.093304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 159/310] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:23 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:24.326907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:24.327514 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:24.334012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:24.334490 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:24.334951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:24.335762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:24.336266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:24.336689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:24.471639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:24.479179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8eeebba5-c190-405c-b5d6-c5e9623dc024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.156243 Oct 19 13:37:24.479724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 152/311] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:24 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:24.584412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1698996160", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebe83939-e1a8-4db7-ba5f-97087a8d3d2e"}], "security_groups": [{"name": "tempest-securitygroup--119484830"}], "key_name": "tempest-keypair-575202321", "user_data": "}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:25.115568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:25.116100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:25.122060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.122586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.123020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.123701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.124157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.124578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.258331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:25.266127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d8ae7107-90a4-494a-a175-261f58d9ac0b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.154506 Oct 19 13:37:25.266708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 153/312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:25 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:25.501393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:25.502001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:25.509162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.509650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.510088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.510807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.511268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.511697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.638695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:25.647755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8d4f6c1d-6d97-43ff-bab0-29eb406cfd36 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.150143 Oct 19 13:37:25.648367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 154/313] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:25 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:26.204750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4dc753-63e8-43c0-80ba-48b9f0237919", "name": "network-vif-plugged", "status": "completed", "tag": "b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:26.214879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.215503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.225684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.227954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] Creating event network-vif-plugged:b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77 for instance aa4dc753-63e8-43c0-80ba-48b9f0237919 on hv-cinder-86188 Oct 19 13:37:26.233139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-3fbcc437-aa5f-418f-88f7-4eea0b38d624 req-2b1024f3-f579-4d09-bf6c-87da1f9c9f08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Oct 19 13:37:26.233720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 155/314] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:37:26.291224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:26.291943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:26.298574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.299057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.299494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.300176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.300701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.301123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.594091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:26.594091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-949f3a81-19c7-4098-9b32-a4a246fe2cad tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.175978 Oct 19 13:37:26.594091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 156/315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:26 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:26.670247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:26.670888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:26.677344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.677816 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.678247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.678946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.679394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.679810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.809000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:26.817163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-75acfccf-7389-4eb4-9038-84c230898209 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.150584 Oct 19 13:37:26.817691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 157/316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:26 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:27.607111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:27.607858 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:27.614396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:27.614901 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:27.615334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:27.616024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:27.616479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:27.616901 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:27.749025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:27.757498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c5f7e222-5036-482e-9edb-654f6dff49ee tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.154324 Oct 19 13:37:27.759756 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 158/317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:27 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:27.841300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:27.842072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:27.851570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:27.851570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:27.851570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:27.851570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:27.851855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:27.851855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:27.987943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:27.998181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-21dc0df7-6068-415c-ae43-2a9edfa5f43c tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.160414 Oct 19 13:37:27.998807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 159/318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:27 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:28.780994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:28.781665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:28.788515 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:28.788994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:28.789429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:28.790111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:28.790594 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:28.791021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:28.924831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:28.932378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-be5f423a-2a10-4009-9f17-edb330dde736 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.155293 Oct 19 13:37:28.933180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 160/319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:28 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:29.021662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:29.022276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:29.028409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.028896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.029338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:29.030027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.030484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.030936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:29.163580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:29.171232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1c49e854-7f72-48a4-9389-034453549588 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.153901 Oct 19 13:37:29.171824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 161/320] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:29 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:29.955472 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:29.956079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:29.959087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=78 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:29.964051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.964522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.964955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:29.965625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.966071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.966498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:30.101633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:30.103879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:30.109881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4e765c54-2e4f-4dc5-b7ca-851a369f0aa6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.158585 Oct 19 13:37:30.114132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 162/321] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:29 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:30.194831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:30.195367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:30.201641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:30.202127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:30.202587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:30.203367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:30.203814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:30.204235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:30.336088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:30.343709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-00bf2f9d-9da4-459e-8f61-241444e39f72 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.153387 Oct 19 13:37:30.344269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 163/322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:30 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:31.131914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:31.132542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:31.138998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.139467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.139906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.140597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.141056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.141487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.270792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:31.278448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ccac8efe-04ab-4fda-8781-7a23063b1bea tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.151058 Oct 19 13:37:31.279032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 164/323] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:31 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:31.367944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:31.368952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:31.375363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.375847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.376328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.377026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.377483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.377910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.507984 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:31.515524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-87c97761-eecd-447c-98a4-0ece2e8abadf tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.153145 Oct 19 13:37:31.516082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 165/324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:31 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:31.966252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:32.263403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] validate_networks() for [('ebe83939-e1a8-4db7-ba5f-97087a8d3d2e', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:37:32.301263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:32.301957 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:32.309118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.309599 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.310030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.310745 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.311201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.311623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.448055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:32.455690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-72c492c4-50b4-4b58-b10a-8b9db671644d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.158323 Oct 19 13:37:32.456251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 166/325] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:32 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:32.539126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:32.539742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:32.545818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.546298 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.546757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.547451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.547898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.548318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.683691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:32.691626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d571b329-1d2e-4c35-b3f3-d355d61ec8c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.157048 Oct 19 13:37:32.692192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 167/326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:32 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:32.841610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:37:32.842035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:37:32.842528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:37:32.842945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:37:32.843362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:37:32.853964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.854443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.854908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.855632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.856087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.856512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.872628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:37:32.876573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Getting quotas for user 020ff888a8a44d2eb6961829407637a9 and project a3e2936fe3344e60b6f3dc918b9c738e. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:37:32.888000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:37:32.890267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:37:33.048068 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5f0a9dde-2ef6-4074-a39c-6d62936cedb9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 8.467970 Oct 19 13:37:33.048704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 160/327] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:37:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 8469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:37:33.060142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-94fa8d05-77a8-4c4a-a47b-8ec8d6e2a912 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:33.060753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-94fa8d05-77a8-4c4a-a47b-8ec8d6e2a912 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:33.112111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-94fa8d05-77a8-4c4a-a47b-8ec8d6e2a912 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:33.118946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-94fa8d05-77a8-4c4a-a47b-8ec8d6e2a912 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1245 microversion: 2.1 time: 0.062986 Oct 19 13:37:33.119579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 168/328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:33 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1245 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:33.477421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:33.477421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:33.477421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.477421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.491572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:33.491572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.491572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.491572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:33.613705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:33.621899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-881ca8d0-7f9c-4639-8deb-1f26e2333a84 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.148514 Oct 19 13:37:33.622450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 161/329] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:33 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:33.714028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:33.714693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:33.721274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.721750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.722181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:33.722892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.723342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.723804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:33.854635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:33.862358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-446fd4ac-2e5b-4f3d-87a9-041602c8b9a9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.152166 Oct 19 13:37:33.862956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 169/330] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:33 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:34.141932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:34.142548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:34.148891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.149369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.149798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.150475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.150956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.151372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.212320 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:34.220183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-14b159a9-fc34-4c93-b394-1ec7e720c7ec tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1249 microversion: 2.1 time: 0.082131 Oct 19 13:37:34.220844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 162/331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:34 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:34.645318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:34.645926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:34.652459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.652942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.653370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.654051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.654576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.655017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.780207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:34.787698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bd4eedd7-5194-468c-b551-5b28e1804e5d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.146199 Oct 19 13:37:34.788256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 170/332] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:34 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:34.885704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:34.886307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:34.892190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.892658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.893085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.893759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:34.894222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:34.894645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.155651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:35.163689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-286c150b-18e4-4572-ac9a-31fd954d9192 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.281766 Oct 19 13:37:35.172105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 163/333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:34 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:35.244278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:35.244885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:35.250787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.251267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.251697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.252377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.252830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.253254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.313132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:35.320852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a79c7b3e-4826-43a2-bd68-29a9ae6acad1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1249 microversion: 2.1 time: 0.081204 Oct 19 13:37:35.321406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 171/334] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:35 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:35.810869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:35.811397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:35.817205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.817675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.818100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.818793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.819234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.819647 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.941260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:35.949172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9916faf5-8b0f-481a-a33f-1241e9d06449 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.142425 Oct 19 13:37:35.949721 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 164/335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:35 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:36.194379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:36.195010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:36.201391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.201890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.208431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.208431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.208431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.208431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.329884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:36.337631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-93050475-1240-472a-a70d-c4f672fe6945 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.147683 Oct 19 13:37:36.338363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 172/336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:36 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:36.342562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:36.343673 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:36.349570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.350047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.350474 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.351184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.351629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.352042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.411150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:36.414486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:36.418983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-53c3b05b-2d1d-4c79-b1e3-1c4d623c88c3 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1249 microversion: 2.1 time: 0.080261 Oct 19 13:37:36.423848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 165/337] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:36 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:36.972214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:36.972749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:36.979282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.979762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.980198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.980887 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.981339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.981761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.109974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:37.117676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-43c297db-840b-440a-a4c3-143304793984 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.149384 Oct 19 13:37:37.118232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 173/338] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:36 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:37.359963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:37.360564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:37.367063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.367538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.367962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.368643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.369092 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.369506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.445617 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:37.446838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:37.453364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.453840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.454267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.455724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.455724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.455929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.499088 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:37.507219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3d5c64a0-cf0d-40a7-8c93-5564a3edbd86 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.151103 Oct 19 13:37:37.507807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 166/339] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:37 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:37.517087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:37.525281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d555ad97-d971-499e-bc12-26b506079e72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1249 microversion: 2.1 time: 0.084044 Oct 19 13:37:37.525835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 174/340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:37 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:38.139814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:38.140427 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:38.148540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.148540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.148540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.148540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.148894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.149027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.273368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:38.280862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-aa83dc66-2b57-4123-bd40-cf1c4c7c3e89 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.144894 Oct 19 13:37:38.283715 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 167/341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:38 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:38.530223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:38.530863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:38.537944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.538431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.538916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.539609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.540074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.540502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.547757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:38.548416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:38.554299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.554806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.555235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.555914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.556362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.556848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.620002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:38.627762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ac0df725-bef6-489c-998e-33c9555168f6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1249 microversion: 2.1 time: 0.083769 Oct 19 13:37:38.628532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 168/342] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:38 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:38.670116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:38.677078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-99eb7711-c778-4aee-a508-58b119804574 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.150688 Oct 19 13:37:38.677641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 175/343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:38 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:39.304365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:39.304965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:39.311168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.311639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.312069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.312749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.313195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.313612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.442620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:39.451398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-26fe2876-6f11-46cd-9695-f6260f73fbb3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.151421 Oct 19 13:37:39.463220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 169/344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:39 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:39.650254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:39.650810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:39.657201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.661390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.661390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.661390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.661390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.662263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.700057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:39.701843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:39.709821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.710307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.710764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.711495 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.711945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.712600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.727603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:39.737094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-26da4f29-4dfc-43b9-bc26-654779ff39a2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.090726 Oct 19 13:37:39.737931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 176/345] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:39 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:39.846535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:39.855008 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-49dd0128-3bf9-413a-a8c0-2dcc6afc7646 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.158769 Oct 19 13:37:39.855557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 170/346] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:39 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:40.475627 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:40.476229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:40.482253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.482764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.483204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:40.483876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.484322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.484739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:40.611792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:40.619330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e7215092-1761-4366-b5f4-488d8131648d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.147596 Oct 19 13:37:40.619882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 177/347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:40 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:40.762000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:40.762558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:40.768470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.768963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.769397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:40.770083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.770562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.770991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:40.833611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:40.841266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-67d46a0d-5cae-4eb3-8c88-2bce9a0c809b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.083220 Oct 19 13:37:40.841827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 171/348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:40 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:40.878041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:40.878682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:40.885853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.886368 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.886849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:40.887573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:40.888043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:40.888477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.016160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:41.023733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4af5819b-d0d7-4152-b9ea-c371590f9aa6 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.149477 Oct 19 13:37:41.024282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 178/349] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:40 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:41.642143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:41.642892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:41.649289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.649771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.650204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.650916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.651367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.651787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.774935 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:41.782393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e5016bec-3e27-41b8-93e1-b9afa75d4255 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.144086 Oct 19 13:37:41.782979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 172/350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:41 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:41.864434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:41.864976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:41.871372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.871833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.872223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.872940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.873395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.873822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.935425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:41.943357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1f7848aa-5f8c-4b37-abae-c0822746fd72 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.082284 Oct 19 13:37:41.943906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 179/351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:41 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:42.046353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:42.046994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:42.052894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.053369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.053799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.054473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.054940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.055355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.181518 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:42.189278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-adcfc920-cdb9-404f-88db-7f879887f7fa tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.146733 Oct 19 13:37:42.194540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 173/352] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:42 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:42.805902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:42.806645 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:42.813356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.813837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.814268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.814991 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.815439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.815859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.830833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:42.941814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:42.951009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-da66e6fb-9506-4588-896d-5fa150d6f7ae tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.148967 Oct 19 13:37:42.956656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 180/353] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:42 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:42.962045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:42.962831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:42.966570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:42.971480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:42.973124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.973607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.974631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.975326 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.975779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.976200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.042321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:43.049932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-081724f9-b4de-440f-bbef-ea533cd3d29a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.088590 Oct 19 13:37:43.050477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 174/354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:42 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:43.213308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:43.213852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:43.215733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:43.220533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.221018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.221450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.222132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.222615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.223043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.351203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:43.358641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8eb524c4-7254-441b-9b26-6a8bb30d54b7 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.149264 Oct 19 13:37:43.359200 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 181/355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:43 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:43.973716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:43.974204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:43.980217 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.980701 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.981133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.981821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.982272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.982724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.073611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:44.074217 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:44.080153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.080637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.081087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.081767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.082221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.082671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.110309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:44.118541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1522e464-de70-411f-8946-d9035cb0d0f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.148901 Oct 19 13:37:44.119122 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 175/356] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:43 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:44.142700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:44.150192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-05d7e63d-dc85-427f-94f2-47a8b7bfa434 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.080522 Oct 19 13:37:44.150801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 182/357] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:44 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:44.381091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:44.381693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:44.388464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.388464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.388464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.389049 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.389494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.389907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.512942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:44.520392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-428e45b8-3e79-4b69-aba0-f2d034b66d65 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.143301 Oct 19 13:37:44.521565 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 176/358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:44 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:45.140952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:45.141556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:45.147977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.148450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.148881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.149551 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.149999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.150410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.172468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:45.173384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:45.179442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.179914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.180343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.181025 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.181472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.181889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.247894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:45.252750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5fa36cf2-204b-4d60-b4e2-c1ca43c8b42d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.084143 Oct 19 13:37:45.253314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 177/359] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:45 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:45.277584 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:45.285111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9cbcf57a-f5a6-4deb-85a3-c64a1c15212d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.147900 Oct 19 13:37:45.285607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 183/360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:45 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:45.543533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:45.544086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:45.549874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.550351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.550820 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.551534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.551987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.552406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.677164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:45.685176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9292f534-e13c-4c38-8f6a-b642dafd0750 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1313 microversion: 2.1 time: 0.145642 Oct 19 13:37:45.685722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 178/361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:45 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:46.275165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:46.275793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:46.282126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.282633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.283068 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.283743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.284191 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.284612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.309116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:46.309717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:46.315898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.316381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.316817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.317509 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.318621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.319076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.351053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:46.359160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-126d12c4-19bd-491e-8710-98faea8963cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.087635 Oct 19 13:37:46.360059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 184/362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:46 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:46.456829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:46.464549 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-112cb585-71c7-40a2-84fe-14821bf09dcd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.159403 Oct 19 13:37:46.465108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 179/363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:46 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:46.708412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:46.709027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:46.715590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.716078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.718755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.718755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.718755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.718755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.026096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:47.033914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2884bd7d-a0a1-46fc-ab1e-2ae453e4cc18 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1498 microversion: 2.1 time: 0.329530 Oct 19 13:37:47.034459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 185/364] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:46 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1498 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:47.280367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df539f7-e7db-4b11-9e94-8ae295de3eb9", "name": "network-vif-plugged", "status": "completed", "tag": "32fdbcaa-a79c-4f91-82aa-12d9415a3d90"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:47.290574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:47.291046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:47.291472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.302735 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] Creating event network-vif-plugged:32fdbcaa-a79c-4f91-82aa-12d9415a3d90 for instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 on hv-cinder-86188 Oct 19 13:37:47.308003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-ed654b89-0484-4c9c-9f2d-ca4fc8e7f170 req-9fa1bdc9-52ed-4f9d-85a1-6475e5bda520 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Oct 19 13:37:47.310703 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 180/365] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:47.385450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:47.386813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:47.392743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:47.393171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:47.393608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.394340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:47.394826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:47.395254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.487716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:47.488396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:47.488607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:47.497836 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1fba0b3a-af51-4488-9b24-89f15440aa51 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1297 microversion: 2.1 time: 0.119427 Oct 19 13:37:47.498669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 186/366] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:47 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:47.498924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:47.500670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:47.501267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.502127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:47.502599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:47.503193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.673418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:47.687451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6087c734-06c1-4d57-9a17-0e3e3cd20c7a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.203939 Oct 19 13:37:47.688494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 181/367] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:47 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:48.522292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:48.522930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:48.534081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.534081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.534081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.534081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.534877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.534877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.664533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:48.672146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fccd9cfd-45b2-456e-94c3-981ca036a417 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.154473 Oct 19 13:37:48.672695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 187/368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:48 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:48.711788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:48.715095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:48.718533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.719031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.719478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.720175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.720631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.721056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.845887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:48.853709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-98d6d04d-134e-43ce-9541-6b857b9d4822 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.146389 Oct 19 13:37:48.859841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 182/369] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:48 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:48.966916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:48.967351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:48.973291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.973770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.974204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.974917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.975373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.975795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.001557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:37:49.291248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cf211b54-81d6-4cdb-8a4b-9309572abd8d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 204 len: 0 microversion: 2.1 time: 0.327911 Oct 19 13:37:49.300013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:49.300744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:49.304007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 188/370] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:37:48 2022] DELETE /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:37:49.307277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.308022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.308450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.309132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.309583 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.310005 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.314168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:49.439857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:49.447467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c5efcbdd-2939-483f-a516-b2e335563ed4 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1504 microversion: 2.1 time: 0.151223 Oct 19 13:37:49.448022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 183/371] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:49 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:49.696704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:49.697546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:49.703963 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.704520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.705156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.705816 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.706341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.706866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.876213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:49.876813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:49.883419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.883895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.884616 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.885303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.885749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.886162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.905855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:49.914607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5270d135-e50b-44b0-88d0-2ec2cc3a4062 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.222154 Oct 19 13:37:49.915184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 189/372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:49 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:50.015497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:50.022951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-615a4bd2-4ee0-4adc-b458-67499a031666 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.150492 Oct 19 13:37:50.023766 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 184/373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:49 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:50.344758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:50.353293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.354193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.354912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.366980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] Creating event network-changed:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:37:50.371893 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-c9244fdf-8d92-4632-8370-63afcc42772a req-6054da8b-9709-4deb-9e83-c447228861aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033371 Oct 19 13:37:50.373366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 190/374] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:50.470211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:50.470879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:50.477149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.477659 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.478090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.478812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.479266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.482174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.604878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:50.612610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4fd9a312-8d4e-4dd4-bf1b-d8680da8151d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1504 microversion: 2.1 time: 0.146295 Oct 19 13:37:50.613172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 185/375] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:50 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:50.939360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:50.940013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:50.946672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.947157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.947593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.948278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.948733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.949161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.045948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:51.046579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:51.053260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.053739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.054165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.056341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.056341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.056341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.078157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:51.089256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5ae3bb9c-7064-4681-a6e2-703b7aeb050f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.154109 Oct 19 13:37:51.093033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 191/376] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:50 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:51.200120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:51.208162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6ee24439-2bf2-425c-a7cb-22f0c830d63a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1318 microversion: 2.1 time: 0.165857 Oct 19 13:37:51.208847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 186/377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:51 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:51.635156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:51.635800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:51.641720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.642207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.642674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.643362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.643820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.644245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.773113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:51.780678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e62f5fe7-1594-4202-96a5-9e24f542b95a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1504 microversion: 2.1 time: 0.149416 Oct 19 13:37:51.781234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 192/378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:51 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:52.112810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:52.113477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:52.119976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.120458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.120896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.121582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.122040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.122465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.231134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:52.231751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:52.241021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.242122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.243896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.245065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.245625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.246583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.253243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:52.261824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dccb6e04-c2e4-45a4-b7a7-d3a244f4abc8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.152837 Oct 19 13:37:52.262730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 187/379] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:52 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:52.373345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:52.381607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0235baed-f688-40e0-aa2a-1de7e19d1311 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1506 microversion: 2.1 time: 0.154392 Oct 19 13:37:52.382169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 193/380] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:52 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:52.803937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:52.804544 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:52.810596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.811079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.811511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.812202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.812652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.813074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.949563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:52.957260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fe0f701b-9762-49ec-a9f8-1bb66bc8eaa9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1504 microversion: 2.1 time: 0.157643 Oct 19 13:37:52.957814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 188/381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:52 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:37:53.285254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:53.285875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:53.293349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:53.293840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:53.294322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:53.295041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:53.295500 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:53.295926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:53.665983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:53.672408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2bee776c-9d4c-437f-9e68-a22b0fb9cc58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.391003 Oct 19 13:37:53.682712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 194/382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:53 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:53.980515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:53.981109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:53.983312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:53.988410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:53.988886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:53.989315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:53.990635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:53.991120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:53.991526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.144153 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:54.154373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7f66d1e9-4d79-41f7-a817-c83a1aec198d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1504 microversion: 2.1 time: 0.177638 Oct 19 13:37:54.155488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 189/383] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:53 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:54.505139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4dc753-63e8-43c0-80ba-48b9f0237919", "name": "network-vif-deleted", "tag": "b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:54.515311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:54.517968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:54.517968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.528148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] Creating event network-vif-deleted:b64a8fb1-9434-4e6e-acf4-7acf5d9e5e77 for instance aa4dc753-63e8-43c0-80ba-48b9f0237919 on hv-cinder-86188 Oct 19 13:37:54.533348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-3bd59dc9-d81d-4ef1-9ee2-b4a9452244aa req-a325101a-6053-4a88-839e-0a82d091251f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Oct 19 13:37:54.533905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 195/384] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:37:54.701343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:54.702627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:54.715990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:54.716593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:54.718892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.719831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:54.728192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:54.728857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.879068 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:54.886873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c5f95625-19ce-46d9-9bb8-2c854c812725 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.192693 Oct 19 13:37:54.887427 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 190/385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:54 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:55.179954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:55.180683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:55.187127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.187609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.188048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.188759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.189214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.189643 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.223146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.223668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.224146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.224674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:37:55.227523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:55.267090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:55.275478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-52d2f29a-ffbf-46b2-b795-aad5a4833104 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.100274 Oct 19 13:37:55.276052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 196/386] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:55 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:55.909671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:55.910283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:55.917091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.922270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.922270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.922270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.922270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.922629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.054308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:56.062289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cc4a3816-8409-4ff2-a3f9-7f2693867f38 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.156507 Oct 19 13:37:56.062939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 191/387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:55 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:56.300572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:56.301344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:56.309011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:56.309561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:56.310213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.311020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:56.311569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:56.312137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.343452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:56.343927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:56.344354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.344788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:37:56.384340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:56.392032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5bdd1b9e-50e2-42d1-88d9-4141ec3f75e3 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.095723 Oct 19 13:37:56.392587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 197/388] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:56 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:57.087455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:57.087972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:57.093873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.094355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.094825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.095514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.095969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.096393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.226757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:57.234460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9c29209e-78a0-459a-8310-acdbc64ffce6 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.151644 Oct 19 13:37:57.235448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 192/389] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:57 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:57.415950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:57.416583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:57.424374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.424905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.425333 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.426064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.426539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.426979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.461749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.462225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.462683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.463119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:37:57.505444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:57.513653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3c8313f6-706c-43bc-be45-9fef9044feee tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.102291 Oct 19 13:37:57.514213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 198/390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:57 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:58.258494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:58.259071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:58.265027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.265618 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.266052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.266762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.267204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.267619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.402664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:58.409383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a479540e-3c58-4523-b6ec-23f880a7e6ce tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.155603 Oct 19 13:37:58.409964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 193/391] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:58 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:58.536443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:58.537593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:58.543806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.544286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.544715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.545392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.545840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.546256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.577415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.577882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.578315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.578774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:37:58.620039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:58.627696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e6ff3af9-469d-4792-a564-4bbfd4ddf92f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.095308 Oct 19 13:37:58.628255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 199/392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:58 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:59.433128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:59.433867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:59.441045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.441717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.442074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.442812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.443295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.444382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.581969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:59.589682 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-eff25455-68f5-44b9-a79e-4a81d7059740 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.160936 Oct 19 13:37:59.599561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 194/393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:59 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:59.650917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:59.651528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:59.658972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.659481 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.659953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.660644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.661091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.661707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.696415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.696888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.697360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.697795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:37:59.737293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:59.745600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c8c97e73-bb87-46eb-9aad-c2bad6a82e46 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.098912 Oct 19 13:37:59.746214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 200/394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:59 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:00.613599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:00.614292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:00.620221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:00.620702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:00.621134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.621825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:00.622272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:00.622731 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.752612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:00.760712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-463a6f1c-09e3-4847-b0c0-7a027d98c1bd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.151018 Oct 19 13:38:00.761265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 195/395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:00 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:00.768500 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:00.769387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:00.774183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:00.778411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:00.778950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:00.779381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.780099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:00.780551 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:00.780971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.811643 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:00.812109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:00.812538 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.812974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:00.853702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:00.861066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-424e1e21-7eff-4638-ae70-b515e2d664ba tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.096541 Oct 19 13:38:00.861625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 201/396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:00 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:01.783744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:01.784354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:01.790968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.791451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.791886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.792568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.793051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.793476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.883631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:01.884430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:01.890569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.891053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.891486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.892179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.892631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.893064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.919922 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:01.925048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.925532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.926205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.926619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:01.927826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f34c8785-55dd-4862-a6e7-2e70e694bf85 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.148012 Oct 19 13:38:01.934572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 196/397] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:01 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:01.969290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:01.977384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7c17d190-b5fc-41d3-ae03-cd506587b7d1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.097594 Oct 19 13:38:01.977941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 202/398] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:01 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:02.950756 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:02.951314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:02.957252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:02.957734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:02.958172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:02.958895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:02.959966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:02.960405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:02.999708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:03.000349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:03.007379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:03.007875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:03.008300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:03.008993 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:03.009446 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:03.009871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:03.043708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:03.044210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:03.044636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:03.045087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:03.085888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:03.090352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:03.093649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-891b7d38-f605-448b-b3e3-3bc80bf4af1a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.097767 Oct 19 13:38:03.094207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 203/399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:02 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:03.098000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1bdff8b3-010c-4720-a4c9-4093d1183ab4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.151201 Oct 19 13:38:03.098656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 197/400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:02 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:04.116029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:04.116636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:04.120162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:04.120777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:04.123097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.123700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.124147 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.124814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.125265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.125685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.126755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.127236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.127670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.128353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.128806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.129227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.164938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.164938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.164938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.164938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:04.202973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:04.211697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-34757029-b00e-4de9-b741-de6e8a180164 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.099467 Oct 19 13:38:04.222654 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 204/401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:04 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:04.275068 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:04.282688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-84d286ab-a895-4e64-a393-66023b1add08 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.166310 Oct 19 13:38:04.283311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 198/402] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:04 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:05.235123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:05.235733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:05.242905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.243386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.243824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.244575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.245008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.245474 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.275935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.276364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.276712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.277154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:05.308474 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:05.309674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:05.324145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.324145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.324145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.324145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.324484 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.324484 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.324653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:05.327445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0fd92fcb-c0e6-4bdb-a9d2-3f19d2dd6d9e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.096261 Oct 19 13:38:05.328005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 205/403] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:05 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:05.449306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:05.452696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:05.457299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6ab5f4a5-2765-429d-89c3-aae1d13a8226 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.154854 Oct 19 13:38:05.459905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 199/404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:05 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:06.350707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:06.351330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:06.357669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:06.358192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:06.358668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:06.359364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:06.359827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:06.360254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:06.390315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:06.390837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:06.391279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:06.391724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:06.433693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:06.441183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e7c609b8-7650-4f6b-9d98-b9a984ed1605 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.094986 Oct 19 13:38:06.441742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 206/405] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:06 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:06.480996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:06.481615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:06.488118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:06.488602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:06.489039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:06.489727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:06.490211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:06.490668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:06.616773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:06.624262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d673a555-4052-4551-b2c2-e4937db260df tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.147105 Oct 19 13:38:06.624816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 200/406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:06 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:07.463315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:07.463919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:07.470180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.470693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.471129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.471807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.472256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.472670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.503017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.503487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.503914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.504345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:07.542811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:07.550105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e497a35a-d5f0-40e1-bcbe-21ffd06b631f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.090550 Oct 19 13:38:07.550689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 207/407] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:07 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:07.646885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:07.647448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:07.653521 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.653997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.654426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.655143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.655595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.656010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.782453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:07.790608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5372c14b-38a2-428d-aa6c-00237cbb9234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.147588 Oct 19 13:38:07.791166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 201/408] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:07 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:08.573835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:08.574449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:08.582158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.582685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.583123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.583804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.584251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.584765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.614803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.615273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.615704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.616641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:08.655917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:08.663453 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3240b93a-978a-4b8f-a07f-e6937345078e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.094181 Oct 19 13:38:08.664003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 208/409] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:08 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:08.813398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:08.814009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:08.820511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.820992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.824464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.824464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.824464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.824464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.958289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:08.968547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1e413b81-da8e-418e-9d67-deb621fb0c1a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.158900 Oct 19 13:38:08.969113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 202/410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:08 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:09.685609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:09.686226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:09.692695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:09.693256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:09.693793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:09.695016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:09.695506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:09.695936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:09.699997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:09.727098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:09.727582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:09.728084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:09.728534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid aa4dc753-63e8-43c0-80ba-48b9f0237919 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:09.767587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:09.775647 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5d0bd375-f1cb-4dde-b3a2-7cec19e95dbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 200 len: 1303 microversion: 2.1 time: 0.094314 Oct 19 13:38:09.776197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 209/411] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:09 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:09.995794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:09.999359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:10.004294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.005457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.005894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.007308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.007769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.008201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.137493 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:10.145245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-936f8923-071f-48ac-839e-30d52ecc5c86 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.153454 Oct 19 13:38:10.154654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 203/412] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:09 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:10.797693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:10.798473 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: aa4dc753-63e8-43c0-80ba-48b9f0237919] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:10.804812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.805297 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.805736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.806428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.807170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.807607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.820836 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] HTTP exception thrown: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Request method failure captured: Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 HTTP/1.1 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_162kU0VnfI_em3PsnTEgBW5uEyrrXe6wuy7qDwnacuo7L0xC0vSSjhVLnOBJNai7Dwv7Y6nDOQg9efVgF6WUk7XtEQEwvlI7zo_S0CfZJ1g6Zs15cuX26_PU4F89h87q0egYzxSJzsJuuZn0j9eJ_8DvVd8GNfJT4hH1v8ZNbhy3w Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 62fb03abd1f64d748b132fa450f641f8 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesActionsTest-771155758 Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:38:10.822548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62fb03abd1f64d748b132fa450f641f8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesActionsTest-771155758 Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 62fb03abd1f64d748b132fa450f641f8 Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesActionsTest-771155758 Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesActionsTest-771155758-project Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: b69eb168c92343b5819d4795eb85dd7a Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesActionsTest-771155758-project Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. Oct 19 13:38:10.824247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'aa4dc753-63e8-43c0-80ba-48b9f0237919'} Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:38:10.825382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. Oct 19 13:38:10.830092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:10.831320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Returning 404 to user: Instance aa4dc753-63e8-43c0-80ba-48b9f0237919 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:38:10.831320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1dee7d23-b6df-44be-8f1d-67739929371f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919" status: 404 len: 111 microversion: 2.1 time: 0.030270 Oct 19 13:38:10.831320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 210/413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:10 2022] GET /compute/v2.1/servers/aa4dc753-63e8-43c0-80ba-48b9f0237919 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:38:10.929714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1812150816", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "networks": [{"uuid": "eef2f5bd-2917-45dc-a8f9-9058fd771b27"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:10.983255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] validate_networks() for [('eef2f5bd-2917-45dc-a8f9-9058fd771b27', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:38:11.168094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:11.169021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:11.175856 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.176342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.177162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.178186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.178684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.179041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.314846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:11.322880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-069bef2d-d83a-4d08-a01a-b1041dc11c2a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.158596 Oct 19 13:38:11.323438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 211/414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:11 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:11.340554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:38:11.341033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:38:11.341459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:38:11.341865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:38:11.342276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:38:11.351044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.351520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.351952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.352672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.353124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.353541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.369691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Getting quotas for project 62fb03abd1f64d748b132fa450f641f8. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:38:11.373643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Getting quotas for user b69eb168c92343b5819d4795eb85dd7a and project 62fb03abd1f64d748b132fa450f641f8. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:38:11.384967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:38:11.387310 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:38:11.521250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2b3ee006-5daf-48fa-845c-3e0e30816186 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595449 Oct 19 13:38:11.521873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 204/415] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:38:11.533024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5ad62bc6-be2f-4c4e-92f0-29beb0e81a9d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:11.533625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ad62bc6-be2f-4c4e-92f0-29beb0e81a9d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:11.586573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5ad62bc6-be2f-4c4e-92f0-29beb0e81a9d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:11.593830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5ad62bc6-be2f-4c4e-92f0-29beb0e81a9d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1214 microversion: 2.1 time: 0.064559 Oct 19 13:38:11.594387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 212/416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:11 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:11.966858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "name": "network-vif-plugged", "status": "completed", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:11.979524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.980041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.980466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.991950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] Creating event network-vif-plugged:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:38:11.996924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-866e35a0-74a2-4d5e-9094-8d3f98776d4b req-ca5e76f3-ced4-4a20-9631-eae1d6b0d0e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033816 Oct 19 13:38:11.999112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 205/417] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:12.346266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:12.346897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:12.353775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.354255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.355817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:12.355817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.355817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.356234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:12.516318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:12.524452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8ea479b8-4d4d-4fce-9720-ac53725093f2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.182026 Oct 19 13:38:12.525012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 213/418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:12 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:12.617182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:12.617871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:12.624059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.624536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.624963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:12.625727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.626163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.626606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:12.690977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:12.704919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2db2fd3f-a476-4e41-a49e-e70cfe611a88 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1218 microversion: 2.1 time: 0.086967 Oct 19 13:38:12.704919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 206/419] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:12 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:13.546902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:13.547520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:13.554683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:13.555164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:13.555600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:13.556287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:13.557054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:13.557476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:13.683859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:13.691338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aa172b4d-8616-4085-8844-5ecb2bcda6c5 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.148439 Oct 19 13:38:13.691889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 214/420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:13 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:13.722057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:13.722769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:13.729376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:13.729860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:13.730295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:13.731223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:13.731775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:13.732205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:13.796865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:13.809247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-278d4873-9f85-458e-a67f-4b3a73c312be tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1218 microversion: 2.1 time: 0.086807 Oct 19 13:38:13.809247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 207/421] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:13 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:14.714084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:14.714716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:14.720727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.721207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.721639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.722450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.722957 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.723382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.830295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:14.831011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:14.837542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.838048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.838536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.839444 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.839920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.840515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.858739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:14.867463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3dacfa0a-d3f5-468a-aa73-c4a1452a4b5c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1370 microversion: 2.1 time: 0.157336 Oct 19 13:38:14.868240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 215/422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:14 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:14.908612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:14.914236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-363d6880-d0e9-4530-9ade-5bb722108da2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1266 microversion: 2.1 time: 0.089008 Oct 19 13:38:14.914956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 208/423] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:14 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:15.890303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:15.890942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:15.898136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.898953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.899391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:15.900084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.900533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.900953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:15.945328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:15.945868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:15.952250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.952945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.953479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:15.954373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.954993 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.955586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:16.030750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:16.038481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-818b7648-c9f1-4487-a024-2bbe74f9c1dd tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1274 microversion: 2.1 time: 0.097569 Oct 19 13:38:16.039060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 209/424] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:15 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:16.051630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:16.060431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3f5cb2ff-a4e4-4a4c-a54b-a8a113bb19e8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1562 microversion: 2.1 time: 0.174151 Oct 19 13:38:16.061101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 216/425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:15 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:16.083304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:16.083792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:16.089619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:16.090096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:16.090550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:16.091237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:16.091689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:16.092108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:16.167938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-75aa5010-2cc4-49df-b9c5-861b72e5d077 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088201 Oct 19 13:38:16.168471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 210/426] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:38:16 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:17.061902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:17.062642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:17.065357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:38:17.065517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Wed Oct 19 13:38:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c (ip 10.222.0.39) !!! Oct 19 13:38:17.072457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.073020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.075718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.075718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.075718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.075718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.141603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:17.150085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-991203dc-a46d-4d07-bff4-eb53c801c461 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1272 microversion: 2.1 time: 0.092247 Oct 19 13:38:17.150777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 217/427] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:17 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:17.515708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:17.525473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.526215 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.526842 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.543260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] Creating event network-changed:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:38:17.548946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-d256265e-3e46-474b-b604-b97abb17fbd8 req-f28a16f0-8e62-4f06-be8a-e6220d6b2382 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036962 Oct 19 13:38:17.553462 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 211/428] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:18.176369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:18.177009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:18.184541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:18.185196 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:18.186178 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:18.186526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:18.186992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:18.187421 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:18.349826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:18.358166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6f733088-06a3-47ce-b013-bff6331b2073 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.186691 Oct 19 13:38:18.358770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 218/429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:18 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:19.380497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:19.381204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:19.387350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:19.387836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:19.388275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:19.389000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:19.389455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:19.389878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:19.516579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:19.524321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ce2762f3-57e7-49f5-9cc7-25aa4154a10e tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.147976 Oct 19 13:38:19.524885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 212/430] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:19 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:20.547826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:20.548452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:20.555305 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:20.555811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:20.556226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:20.557170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:20.557804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:20.565394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:20.851997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:20.859742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-13c2e000-afec-42bc-a71a-80ccea73fc11 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.315719 Oct 19 13:38:20.860390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 219/431] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:20 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:21.883755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c", "tag": "29c58d53-3e0f-4c92-b46e-905e23621196"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:21.884269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:21.884638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:21.886694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:21.892061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:21.892606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:21.892972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:21.893517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:21.893964 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:21.894869 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:21.895465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:21.895625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:21.895936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:21.896360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:21.896508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:21.909476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] Creating event network-changed:29c58d53-3e0f-4c92-b46e-905e23621196 for instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c on hv-cinder-86188 Oct 19 13:38:21.914817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-b6111ce7-73a5-488c-a195-c0a159005b63 req-5227edd2-a305-405f-b2b8-d81a1af089b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034908 Oct 19 13:38:21.916612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 213/432] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:22.094333 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:22.102101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4b9c408e-6317-4de5-8f3b-a9bf260a5f51 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.222521 Oct 19 13:38:22.114954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 220/433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:21 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:23.126481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:23.127238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:23.133797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:23.134279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:23.134816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:23.135507 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:23.135962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:23.136412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:23.265360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:23.273223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5c483a54-a544-4a09-8498-3f879a8be10a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.151516 Oct 19 13:38:23.273787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 214/434] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:23 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:24.296251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:24.296972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:24.303988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:24.304484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:24.304921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:24.305615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:24.306072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:24.306770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:24.435722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:24.443309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b390df09-21b9-4ce6-ac00-a74c1af599c5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.150965 Oct 19 13:38:24.443868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 221/435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:24 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:25.466660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:25.467273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:25.469233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:25.473807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:25.474285 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:25.474755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:25.475443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:25.475893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:25.476316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:25.601805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:25.609409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-485d5bca-cbcb-4eda-91ce-22bc85a76050 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.146635 Oct 19 13:38:25.609959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 215/436] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:25 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:26.631815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:26.632450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:26.638849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:26.639324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:26.639755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:26.640428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:26.640876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:26.641294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:26.764400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:26.771935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-35c77665-192f-45e8-ad4c-1f59429ec942 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.144023 Oct 19 13:38:26.772982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 222/437] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:26 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:27.794835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:27.795349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:27.801494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:27.801976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:27.802407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:27.803151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:27.804163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:27.804617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:27.937555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:27.945519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-aed5f0b2-e77e-474a-b09c-4c2576993874 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.154648 Oct 19 13:38:27.946078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 216/438] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:27 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:28.968664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:28.969261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:28.975775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:28.978372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:28.978372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:28.978372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:28.978372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:28.978785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:29.110639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:29.118949 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0be2d4d4-b796-432f-ad29-f3dc260d948f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.154114 Oct 19 13:38:29.119506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 223/439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:28 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:30.141055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:30.144317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:30.148245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:30.148723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:30.149154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:30.149839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:30.150295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:30.150746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:30.280598 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:30.288290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f1666428-dade-4599-9560-2e14772ef327 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.151136 Oct 19 13:38:30.288849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 217/440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:30 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:31.208995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acecec25-8e9b-44fa-8f04-3052e47911d9", "device": "/dev/sdb"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:31.213293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:31.217944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=66 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:31.222157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.222844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.223454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.224300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.225066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.225611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.311220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:31.312423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:31.318795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.319550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.320176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.321186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.321848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.322478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.463054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:31.470626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fd750a09-2f9e-4e3a-80dc-ea011210a0b9 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.163307 Oct 19 13:38:31.471183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 218/441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:31 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:32.373879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5697c0f2-ba99-40dd-9f9c-13a0bb1cb9fc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "POST /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.169273 Oct 19 13:38:32.374634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 224/442] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:38:31 2022] POST /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9/os-volume_attachments => generated 194 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:32.493581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:32.494112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:32.500053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:32.500523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:32.500946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:32.501617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:32.502063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:32.502476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:32.521508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:32.626321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:32.634371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-15b86b30-6954-492f-b8ad-c8b83e1d8718 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.145168 Oct 19 13:38:32.634956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 219/443] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:32 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:33.658903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:33.659604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:33.665685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:33.666165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:33.666633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:33.667314 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:33.667770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:33.668197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:33.796728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:33.799005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:33.804823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-12b9927f-da80-4967-b826-c95690a08e9f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.150608 Oct 19 13:38:33.805376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 225/444] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:33 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:34.827742 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:34.828345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:34.834988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:34.835463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:34.835887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:34.836557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:34.837003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:34.837414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:34.961401 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:34.968944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c36c6e8d-95a2-47e7-a152-21591d0769e5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.145047 Oct 19 13:38:34.969504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 220/445] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:34 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:35.992477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:35.993091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:36.001114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:36.001814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:36.002449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:36.003332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:36.003944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:36.004525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:36.141471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:36.149077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d0b81421-b38e-4c4a-9c43-5728952710db tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.161103 Oct 19 13:38:36.149633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 226/446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:35 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:37.171720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:37.172328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:37.178690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:37.179184 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:37.183393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:37.183393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:37.183393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:37.183393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:37.315218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:37.322773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fad20f2e-5b2a-45b8-95fa-b2ae5d54be04 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.154866 Oct 19 13:38:37.323338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 221/447] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:37 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:37.571571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c", "name": "network-vif-plugged", "status": "completed", "tag": "29c58d53-3e0f-4c92-b46e-905e23621196"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:37.581530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:37.582004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:37.582437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:37.593360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] Creating event network-vif-plugged:29c58d53-3e0f-4c92-b46e-905e23621196 for instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c on hv-cinder-86188 Oct 19 13:38:37.598586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-6dca22d7-51a7-4a21-b9dc-b39d08da60a4 req-b3a88bfe-5e31-4b5e-adb2-1d4650cc8b5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030747 Oct 19 13:38:37.603754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 227/448] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:38:38.345203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:38.345815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:38.351751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:38.352224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:38.352652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:38.353328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:38.353775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:38.354191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:38.482875 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:38.491067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-79e5c3de-ab50-489f-ab8f-68cb1a9dedd5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.149163 Oct 19 13:38:38.491558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 222/449] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:38 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:39.514704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:39.515396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:39.521508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:39.521983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:39.522418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:39.523123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:39.523573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:39.524042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:39.653575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:39.661562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-65d045c8-9be2-4892-9a75-2d26a893660d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.151498 Oct 19 13:38:39.661995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 228/450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:39 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:40.686522 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:40.687225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:40.693256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:40.693850 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:40.694338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:40.695269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:40.695830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:40.696339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:40.825862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:40.835111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8143707d-502c-452b-8c06-7d28e0f7071f tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.152295 Oct 19 13:38:40.835607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 223/451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:40 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:41.858526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:41.859137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:41.866301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:41.866812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:41.867256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:41.867943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:41.868397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:41.868818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:41.994255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:42.002267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b5b4e891-aab4-4037-bb18-1ae9bb982793 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.147551 Oct 19 13:38:42.002870 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 229/452] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:41 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:43.025151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:43.025799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:43.031816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:43.032298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:43.032730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:43.033415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:43.033865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:43.034288 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:43.157933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:43.165478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-14cb46a1-3d02-4bfd-b117-34e4e67382c2 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.144149 Oct 19 13:38:43.171312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 224/453] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:43 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:44.192700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:44.193268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:44.200165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:44.202967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:44.202967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:44.202967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:44.202967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:44.203459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:44.331285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:44.339502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7129e219-6440-4691-8abf-005a98e9e643 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1314 microversion: 2.1 time: 0.150799 Oct 19 13:38:44.340065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 230/454] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:44 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:45.417917 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:45.418550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:45.424741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:45.425239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:45.425678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:45.426367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:45.426860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:45.427284 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:45.560356 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:45.568507 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fd28f3dd-b7ff-4fd3-b723-d28d6a1da003 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1498 microversion: 2.1 time: 0.154462 Oct 19 13:38:45.570587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 225/455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:45 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:47.005276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:47.005894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:47.012403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.013015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.013448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.014137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.014611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.015032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.044258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:38:47.301384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-410acb06-1920-4daa-b26a-5ee0f20fafbc tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 204 len: 0 microversion: 2.1 time: 0.299635 Oct 19 13:38:47.301962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 231/456] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:38:47 2022] DELETE /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:38:47.310587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:47.311200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:47.317204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.317684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.318113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.318831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.319769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.320250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.450676 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:47.458990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f3d144ba-92b3-4dd9-a6e3-39755cebf91d tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.152306 Oct 19 13:38:47.459629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 226/457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:47 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:48.482181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:48.482926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:48.489168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:48.489650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:48.490081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:48.490899 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:48.491244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:48.491660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:48.628497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:48.637003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7f79de2b-d971-4a07-a0ac-46c343c30989 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.158953 Oct 19 13:38:48.638120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 232/458] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:48 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:49.660353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:49.660967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:49.667630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:49.668117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:49.668553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:49.669226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:49.669685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:49.670107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:49.802019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:49.810977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0bdf0e3d-8eac-4ec6-86fc-e7fdd61f4024 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.154404 Oct 19 13:38:49.811930 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 227/459] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:49 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:50.834031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:50.834685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:50.841056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:50.841537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:50.841966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:50.842692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:50.843149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:50.843581 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:50.976662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:50.984997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-24a25a0f-43e6-4a0d-a159-694241a366a1 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.154741 Oct 19 13:38:50.985555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 233/460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:50 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:52.008791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:52.010063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:52.016141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:52.016626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:52.017060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:52.017760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:52.018268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:52.018681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:52.152390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:52.164873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-85aaaf75-fcc7-4de1-9bdc-a0538ff33f94 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.159959 Oct 19 13:38:52.166672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 228/461] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:52 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:53.187824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:53.188431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:53.195174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:53.195712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:53.196487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:53.197182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:53.198210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:53.199022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:53.352009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:53.359715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-607a9db4-011f-4a51-b4e9-dca3dc5dce67 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1504 microversion: 2.1 time: 0.175650 Oct 19 13:38:53.360266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 234/462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:53 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:53.884460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c", "name": "network-vif-deleted", "tag": "29c58d53-3e0f-4c92-b46e-905e23621196"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:38:53.894526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:53.897137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:53.897137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:53.906990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] Creating event network-vif-deleted:29c58d53-3e0f-4c92-b46e-905e23621196 for instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c on hv-cinder-86188 Oct 19 13:38:53.912041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-edecc481-2b4d-44bf-b1fb-03aa5e3152dc req-1071b8c1-b684-4689-ac47-c47efb3eecf6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Oct 19 13:38:53.912653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 229/463] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:38:54.383364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:54.383976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:54.391227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:54.391716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:54.392183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:54.392877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:54.393336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:54.393769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:54.425718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:54.426228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:54.426693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:54.427306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:54.469240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:54.476993 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4b0f629b-4ac5-49cb-8025-866c54f49220 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1304 microversion: 2.1 time: 0.097556 Oct 19 13:38:54.477873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 235/464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:54 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:38:55.501469 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:55.502169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:55.508168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:55.508646 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:55.509073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:55.509787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:55.510240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:55.510698 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:55.538798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=32 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:55.543090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:55.543653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:55.544180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:55.544685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:55.592247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:55.599712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-59495609-e955-4482-a208-c6df260c0784 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1304 microversion: 2.1 time: 0.102496 Oct 19 13:38:55.600262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 230/465] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:55 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:56.623646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:56.624846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:56.631779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:56.632268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:56.632707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:56.633406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:56.633971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:56.634278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:56.666540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:56.666995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:56.667561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:56.668015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:56.708183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:56.715931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d68415ca-a821-4da0-82c1-ee86c4170b21 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1304 microversion: 2.1 time: 0.096754 Oct 19 13:38:56.716537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 236/466] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:56 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:57.739625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:57.740231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:57.746103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:57.746610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:57.747045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:57.747729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:57.748182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:57.748604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:57.779188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:57.779658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:57.780091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:57.780526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lazy-loading 'fault' on Instance uuid b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:38:57.819173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69eb168c92343b5819d4795eb85dd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fb03abd1f64d748b132fa450f641f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:57.827242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1f9c24ab-5249-456e-a27c-b4287c72cea5 tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 200 len: 1304 microversion: 2.1 time: 0.091538 Oct 19 13:38:57.827796 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 231/467] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:57 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:58.849666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:58.850284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] [instance: b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:58.857557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:58.858035 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:58.858540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:58.859183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:58.859638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:58.860057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:58.873282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] HTTP exception thrown: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Request method failure captured: Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c HTTP/1.1 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_162kU0VnfI_em3PsnTEgBW5uEyrrXe6wuy7qDwnacuo7L0xC0vSSjhVLnOBJNai7Dwv7Y6nDOQg9efVgF6WUk7XtEQEwvlI7zo_S0CfZJ1g6Zs15cuX26_PU4F89h87q0egYzxSJzsJuuZn0j9eJ_8DvVd8GNfJT4hH1v8ZNbhy3w Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 62fb03abd1f64d748b132fa450f641f8 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesActionsTest-771155758 Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:38:58.874932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62fb03abd1f64d748b132fa450f641f8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62fb03abd1f64d748b132fa450f641f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesActionsTest-771155758 Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 62fb03abd1f64d748b132fa450f641f8 Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesActionsTest-771155758 Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesActionsTest-771155758-project Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: b69eb168c92343b5819d4795eb85dd7a Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesActionsTest-771155758-project Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. Oct 19 13:38:58.876541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c'} Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:38:58.877312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. Oct 19 13:38:58.878740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:38:58.880260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] Returning 404 to user: Instance b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:38:58.880260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3879d968-7ac3-43ce-bc6c-f99d47c6556a tempest-VolumesActionsTest-771155758 tempest-VolumesActionsTest-771155758-project] 10.222.0.39 "GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c" status: 404 len: 111 microversion: 2.1 time: 0.030645 Oct 19 13:38:58.880260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 237/468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:58 2022] GET /compute/v2.1/servers/b4636e67-c85b-4a9c-a1a5-c64ccf6cb15c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:39:16.061446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:16.061985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:16.069668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=5 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:16.070592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=74 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:16.072218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:16.072854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:16.073302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:16.074013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:16.074473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:16.074928 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:16.282544 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'services' on Instance uuid 9df539f7-e7db-4b11-9e94-8ae295de3eb9 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:39:16.564779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3ece18ce-9a3f-43ce-8026-9d77b407a141 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9/os-volume_attachments/acecec25-8e9b-44fa-8f04-3052e47911d9" status: 202 len: 0 microversion: 2.1 time: 0.507309 Oct 19 13:39:16.565460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 232/469] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:39:16 2022] DELETE /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9/os-volume_attachments/acecec25-8e9b-44fa-8f04-3052e47911d9 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:39:18.433740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:18.437160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:18.440901 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:18.444630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:18.445076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:18.445758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:18.446361 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:18.447259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:18.447715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:18.448143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:18.583013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7b9612ee-95f5-4f42-bfd2-901b48321a3c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action" status: 200 len: 28730 microversion: 2.20 time: 0.154630 Oct 19 13:39:18.584066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 238/470] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 13:39:18 2022] POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action => generated 28730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 19 13:39:19.035343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:19.035932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:19.060475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:19.061225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:19.061816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:19.063292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:19.067000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:19.067620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:19.113641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:39:19.547961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cd08b18e-99f2-4af8-bef2-49c475cd81ba tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 204 len: 0 microversion: 2.1 time: 0.515672 Oct 19 13:39:19.548884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 233/471] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:39:19 2022] DELETE /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:39:19.561312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:19.562491 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:19.572527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:19.573336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:19.574000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:19.575007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:19.575811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:19.576464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:20.035521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:20.048339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-acf25b5d-dc67-4be8-9fe1-be3a4e75e268 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1512 microversion: 2.1 time: 0.493621 Oct 19 13:39:20.054891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 239/472] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:19 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:21.076562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:21.077465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:21.084499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:21.085317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:21.085999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:21.086962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:21.087685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:21.088364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:21.418045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:21.427967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b4090f70-40fb-4929-b7c2-8ad7329cd8d2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1512 microversion: 2.1 time: 0.356951 Oct 19 13:39:21.429198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 234/473] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:21 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:22.459475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:22.460121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:22.487390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:22.490700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:22.491363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:22.494667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:22.495356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:22.497598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:22.873527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:22.892244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-69596ebe-a1c9-45cd-9e3f-4f78fac414f4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1512 microversion: 2.1 time: 0.438654 Oct 19 13:39:22.899648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 240/474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:22 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:23.014009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df539f7-e7db-4b11-9e94-8ae295de3eb9", "name": "network-vif-deleted", "tag": "32fdbcaa-a79c-4f91-82aa-12d9415a3d90"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:23.028667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:23.029160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:23.029697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:23.047460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] Creating event network-vif-deleted:32fdbcaa-a79c-4f91-82aa-12d9415a3d90 for instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 on hv-cinder-86188 Oct 19 13:39:23.052915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-5bc94f49-0ec7-492f-a9c7-a788b94f84a9 req-18aed5cd-f81e-4bb0-9c6d-3e578261cc8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042882 Oct 19 13:39:23.053968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 235/475] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:39:23.928484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:23.929618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:23.957403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:23.957796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:23.958240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:23.958976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:23.959436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:23.959863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:24.021408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:24.022690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:24.023295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:24.024027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'fault' on Instance uuid 9df539f7-e7db-4b11-9e94-8ae295de3eb9 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:39:24.077107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:24.103528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9082ea36-2b9e-4641-a6fc-689e818ac281 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 200 len: 1308 microversion: 2.1 time: 0.179975 Oct 19 13:39:24.104734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 241/476] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:23 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:25.143345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:25.144446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 9df539f7-e7db-4b11-9e94-8ae295de3eb9] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:25.151721 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:25.152753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:25.153418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:25.154355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:25.155029 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:25.155666 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:25.173634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] HTTP exception thrown: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Request method failure captured: Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 HTTP/1.1 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_2D-WPOl2HMsqDGBz2cPJfdcrdFrvfa400eFZOXXQmOjPVM-QeKMLbq7bqC18dqS-PoNK1pZKb1BI7Bt-Q0__BpT-ZqXvSdDNa1p1yZfwMhLkU-L52LszrtTjmcQWaI1sF7yF3uxGKraBQI1a7Jthzt-q0D4-v7h-lrSHUjGVL0p0M Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: c20b3147c0d14452b9c5f22801c89990 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:39:25.178791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c20b3147c0d14452b9c5f22801c89990", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: c20b3147c0d14452b9c5f22801c89990 Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-VolumesSnapshotTestJSON-1256992264-project Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: eb7a8349031b4f87a4f477e4a4e6ba2b Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-VolumesSnapshotTestJSON-1256992264-project Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. Oct 19 13:39:25.180830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '9df539f7-e7db-4b11-9e94-8ae295de3eb9'} Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:39:25.181894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. Oct 19 13:39:25.183736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:39:25.185094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Returning 404 to user: Instance 9df539f7-e7db-4b11-9e94-8ae295de3eb9 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:39:25.185094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-228f4385-653b-4a59-88a0-e8cbc8c2b150 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9" status: 404 len: 111 microversion: 2.1 time: 0.049217 Oct 19 13:39:25.187845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 236/477] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:25 2022] GET /compute/v2.1/servers/9df539f7-e7db-4b11-9e94-8ae295de3eb9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:39:29.964818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:29.966198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:29.978969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:29.979464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:29.979903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:29.980612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:29.981074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:29.981495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:30.080400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2de9e518-b4a2-4a4c-a696-449bb0b2fccc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/ips" status: 200 len: 152 microversion: 2.20 time: 0.119314 Oct 19 13:39:30.098635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 242/478] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Oct 19 13:39:29 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/ips => generated 152 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:39:34.147202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:34.148958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:34.160843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:34.166424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:34.167136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:34.168558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:34.171737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:34.175167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:34.210403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lazy-loading 'flavor' on Instance uuid d15930e1-efde-41f3-a7b7-0da49230281e {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:39:34.933901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-819d4319-fc6e-4346-98a4-c14a30318a78 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action" status: 202 len: 0 microversion: 2.20 time: 0.790019 Oct 19 13:39:34.937437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 237/479] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 13:39:34 2022] POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:39:34.969332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:34.969986 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:34.994492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:34.995102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:34.995547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:34.996268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:35.001651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:35.002136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:35.334037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:35.350428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:35.352081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:35.353318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5408feea-d495-4288-a898-8e3cec4c6b31 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.407622 Oct 19 13:39:35.366727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 243/480] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:34 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:36.196419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ece8aaee-18a9-410b-90a1-f1169fa55412 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Action: 'create', calling method: .version_select at 0x7fb41e5adca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-857404674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6H/IJwrxZJL3Upxp6Rba1sKjicPq4A1T7rQbwSkaFG3NgiXxxxVvqUfVOFSgy0zZJd4HVDyxgpmNaWBdEz4tkl8Dhd+d5CEneJlpLywbWoj8c6oMK8w8DURXwYwglEXA=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:36.215572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-ece8aaee-18a9-410b-90a1-f1169fa55412 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:39:36.220659 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-ece8aaee-18a9-410b-90a1-f1169fa55412 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for user e7a6ae7333d2422ebc9f616d482e527a and project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:39:36.313055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ece8aaee-18a9-410b-90a1-f1169fa55412 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.581455 Oct 19 13:39:36.314050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 238/481] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:39:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:39:36.386259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:36.387326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:36.401529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:36.402395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:36.404373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:36.408328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:36.409214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:36.411638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:36.683346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:36.701277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:36.703346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:36.708423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e6c116b6-ecc2-42a5-8f11-3782e2c42088 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.326638 Oct 19 13:39:36.712489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 244/482] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:36 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:37.744067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:37.744810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:37.761697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:37.762198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:37.762664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:37.763380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:37.765392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:37.765392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:38.030584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:38.044409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:38.046572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:38.047779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9dc49340-ab10-4f17-ae2c-07b5a1aca351 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.307718 Oct 19 13:39:38.055667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 239/483] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:37 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:39:39.073711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:39.075148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:39.082661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:39.083440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:39.084093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:39.085031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:39.085683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:39.086318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:39.317396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:39.328439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:39.330402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:39.331671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-80c02f0e-42c7-4fab-ae06-1d0726fe91cf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.262209 Oct 19 13:39:39.332544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 245/484] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:39 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:40.360968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:40.361590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:40.368752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:40.371459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:40.371459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:40.371459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:40.372838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:40.373467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:40.762333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:40.771989 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:40.803893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:40.805368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-04ef7ec8-1afe-4cf7-8ce5-c1601d5ac178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.449060 Oct 19 13:39:40.811802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 240/485] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:40 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:40.899274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1550408733", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "networks": [{"uuid": "f3a65e36-8a53-4746-84eb-5af871f9374d"}]}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:41.022157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] validate_networks() for [('f3a65e36-8a53-4746-84eb-5af871f9374d', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:39:41.836196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:41.837764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:41.878641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:41.886183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:41.887991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:41.892116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:41.892821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:41.894436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:42.172166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:39:42.174583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:39:42.202847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:39:42.203787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:39:42.206396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:39:42.228261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:42.229020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:42.229749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:42.231867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:42.232397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:42.232884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:42.273256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Getting quotas for project c20b3147c0d14452b9c5f22801c89990. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:39:42.279188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Getting quotas for user eb7a8349031b4f87a4f477e4a4e6ba2b and project c20b3147c0d14452b9c5f22801c89990. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:39:42.308421 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:39:42.312736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:39:42.497182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-278dd5ad-7f4d-45da-b298-b583ff90810b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601876 Oct 19 13:39:42.505589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 246/486] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:39:42.511633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6618a768-4c06-4851-a831-9c2f14abbdaf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:42.512624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6618a768-4c06-4851-a831-9c2f14abbdaf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:42.580075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:42.591919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:42.595950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:42.602633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6618a768-4c06-4851-a831-9c2f14abbdaf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:42.604143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e33a881a-0367-4a64-9f9f-847d7ce06fc9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.771889 Oct 19 13:39:42.607067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 241/487] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:41 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:42.612457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6618a768-4c06-4851-a831-9c2f14abbdaf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1219 microversion: 2.1 time: 0.105298 Oct 19 13:39:42.628653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 247/488] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:42 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:43.633824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:43.637342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:43.644848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:43.645359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:43.653121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:43.653835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:43.654421 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:43.655321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:43.657419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:43.658171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:43.662547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:43.663080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:43.664878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:43.665609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:43.666074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:43.666530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:43.852361 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:43.863443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-387242aa-72a7-4dbf-b695-5109324e1c3a tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1223 microversion: 2.1 time: 0.222552 Oct 19 13:39:43.879118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 248/489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:43 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1223 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:44.041338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:44.054869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:44.056566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:44.060033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cf1918b5-421d-4c92-942d-7673d1e13ef7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.433537 Oct 19 13:39:44.060604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 242/490] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:43 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:44.887107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:44.887719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:44.900754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:44.903407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:44.903407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:44.903407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:44.903407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:44.903781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:45.006070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:45.016641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9aab738f-faa2-4844-93af-94fdf43de624 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1271 microversion: 2.1 time: 0.133231 Oct 19 13:39:45.017758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 249/491] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:44 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:45.092124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:45.094219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:45.103292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:45.103785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:45.104217 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:45.105359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:45.105811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:45.106414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:45.327893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:45.336336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:45.339268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:45.343558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ac7e6e2d-ae6d-4070-b37c-ccd4a2eb8fc6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.258138 Oct 19 13:39:45.345499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 243/492] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:45 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:46.043083 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:46.045623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:46.082252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.082813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.083259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.083975 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.095566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.096341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.234564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:46.245159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ab4d64ca-b578-46e1-ba7c-2d4b6d13e7e2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1277 microversion: 2.1 time: 0.208082 Oct 19 13:39:46.246112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 250/493] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:46 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:46.370588 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:46.373954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:46.385032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:46.391281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:46.419848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.433334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.437528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.448109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.455810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.464287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.477548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:46.707421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:46.720556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:46.721009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:46.723726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9c650f37-2e02-493b-9b52-10173946fdbd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.357507 Oct 19 13:39:46.725255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 244/494] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:46 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:47.272846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:47.273499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:47.284081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.285184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.286466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.291434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.292117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.292565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.567489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:47.583358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-83784ae3-5803-4c21-818c-eee1ce2b82a2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.314326 Oct 19 13:39:47.599121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 251/495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:47 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:47.756260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:47.756882 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:47.767442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.768271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.768878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.769767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.770412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.771039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.901200 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be44629-963d-4b29-a35b-4d44167bc3a0", "tag": "b4081753-ab74-478c-8676-6cd09a91aa21"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:47.926202 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.927006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.927596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.941963 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] Creating event network-changed:b4081753-ab74-478c-8676-6cd09a91aa21 for instance 6be44629-963d-4b29-a35b-4d44167bc3a0 on hv-cinder-86188 Oct 19 13:39:47.947161 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:47.950486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-27e9c09d-9ae8-497b-b148-839fe3d9be72 req-15eb0a0e-d301-45d2-95fd-cb4dd7239d36 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052105 Oct 19 13:39:47.954469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 252/496] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:39:47.956468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:47.957908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:47.959101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1932e92a-74c3-4390-8fc9-12964f23680a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.211185 Oct 19 13:39:47.959653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 245/497] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:47 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:48.608713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:48.612047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:48.625172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:48.625932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:48.626705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:48.631563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:48.632353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:48.633797 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:48.970857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:48.970857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bdb923ed-b909-45b2-80dd-4897cd46bbf9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.339729 Oct 19 13:39:48.970857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 253/498] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:48 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:48.993807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:49.050625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:49.050625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:49.050625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:49.050625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:49.051678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:49.051678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:49.051678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:49.261572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:49.277849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:49.287172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:49.288629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d15aa44d-c46d-40d0-825f-71fa50491653 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.303174 Oct 19 13:39:49.289207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 246/499] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:48 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:49.983943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:49.984556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:49.990930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:49.992602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:49.993282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:49.993704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:49.994393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:49.998904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:50.012458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:50.012458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=81 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:50.208157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:50.218266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e0eade21-614f-4427-9f64-221744a0d3be tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.238052 Oct 19 13:39:50.219781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 254/500] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:49 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:39:50.555954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:50.556707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:50.565866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:50.567681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:50.568321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:50.569185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:50.586916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:50.587771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:50.769159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:50.781179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:50.783137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:50.784469 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c8ccb1f6-0968-4f6b-b7db-337761001016 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.470679 Oct 19 13:39:50.804187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 247/501] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:50 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:51.245301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:51.246499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:51.253345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.254163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.254948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:51.255831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.256520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.257257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:51.437856 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:51.450054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-24fa1ed2-b05e-4898-a1cc-ac138d1dc2e6 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.208983 Oct 19 13:39:51.463266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 255/502] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:51 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:51.816235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:51.816852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:51.827523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.828077 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.828522 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:51.830697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.831571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.832226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:52.062231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:52.075383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:52.081642 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:52.083412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-114c5daf-b759-4cfc-b3d7-79f24726b1f0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.274079 Oct 19 13:39:52.084596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 248/503] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:51 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:52.478758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:52.480027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:52.486158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:52.489021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:52.489703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:52.490205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:52.490932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:52.491386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:52.491801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:52.611440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=8 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:52.694839 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:52.705165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-17f52dce-6db1-4cd8-967f-f357022d26c8 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.231326 Oct 19 13:39:52.705841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 256/504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:52 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:53.112991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:53.113621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:53.120839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.124353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.124353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.124353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.124353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.124685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.264998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:53.273377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:53.275434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:53.276582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-70909441-ef6c-47c8-8bad-dfe5b0190f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.167714 Oct 19 13:39:53.277137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 249/505] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:53 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:53.729789 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:53.730425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:53.737436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.738022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.738462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.739170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.739622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.740044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.916122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:53.925126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-06b1b87b-8043-4732-8269-049c8e4a29dd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.199217 Oct 19 13:39:53.941234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 257/506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:53 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:54.305818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:54.309539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:54.322945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.332141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.333016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:54.334413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.336115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.338101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:54.501910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:54.514590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:54.516384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:54.517605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ac353c6f-f29a-40dd-9e03-c11923cca481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.218938 Oct 19 13:39:54.518126 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 250/507] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:54 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:54.950861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:54.952286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:54.966988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.968033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.968673 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:54.970941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.974398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.974398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:55.176877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:55.185651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5b2d3c00-d500-4cea-b3bc-3bedcbbc9ffc tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.240430 Oct 19 13:39:55.186585 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 258/508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:54 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:55.546157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:55.547916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:55.576797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:55.577638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:55.578396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:55.583904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:55.587454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:55.588244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:55.752653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:55.764199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:55.766170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:55.767677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-62326ce7-f657-4638-8b4c-32dc37791418 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.228135 Oct 19 13:39:55.768704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 251/509] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:55 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:39:56.211257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:56.211980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:56.223857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.227451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.228075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.229007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.229662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.231117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.387011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:56.394964 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-273d0c2c-7a29-4dd9-94b6-6798218815c9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.187647 Oct 19 13:39:56.395526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 259/510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:56 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:56.795763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:56.796489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:56.803021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.803498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.804189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.804869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.805318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.805737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.938661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:56.948257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:56.954222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:56.955753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e75e4da3-c441-443b-8d3b-7b72a59ad48d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.165417 Oct 19 13:39:56.956450 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 252/511] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:56 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:57.081679 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "name": "network-vif-plugged", "status": "completed", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:57.091082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.101213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.101213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.103856 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] Creating event network-vif-plugged:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:39:57.109001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-9be9369e-5d21-47cb-8635-b34125db5c56 req-e1d4140f-50f2-478d-8dd1-d5ab858e8f6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031014 Oct 19 13:39:57.109576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 260/512] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:39:57.416682 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:57.417570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:57.424711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.425404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.425998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.426731 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.427185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.427605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.573864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:57.583624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-41f607dc-d8db-4f8e-96e1-fff2c19893c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.170682 Oct 19 13:39:57.590678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 253/513] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:57 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:57.986149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:57.987009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:57.993105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.993607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.994044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.994761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.995222 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.995789 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.108178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2fb4d25b-d3cd-4599-9a48-c7ee2099d87f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'create', calling method: .version_select at 0x7fb41e700dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2006773446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGaQpHcr5+HLci9gm4km6wv+HjCPE2b/QbPl2Cwj82d9/9RV33d52c5z/GHArjthFX04AauuFiTGui+dg2BO6P15eVvL0p+lhsqxgbo5oB01Ez8nJnOwRCNHxc6b7YExw=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:58.130667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-2fb4d25b-d3cd-4599-9a48-c7ee2099d87f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Getting quotas for project 4cb6b4edda314963acad175089204599. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:39:58.132306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-2fb4d25b-d3cd-4599-9a48-c7ee2099d87f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Getting quotas for user 906899df35c14f9eb20415c513a8b599 and project 4cb6b4edda314963acad175089204599. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:39:58.203878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2fb4d25b-d3cd-4599-9a48-c7ee2099d87f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.101156 Oct 19 13:39:58.204890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 254/514] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:39:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:39:58.326136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1097236095", "imageRef": "85ea7524-6e95-48ee-a55f-2114d51da659", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2006773446", "networks": [{"uuid": "820ad496-e015-4103-bf1e-3aed07811aba"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:39:58.331546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:58.345495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:58.347023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:58.348177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bee45e19-1102-4edc-8677-7139b10216ce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.367448 Oct 19 13:39:58.348731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 261/515] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:57 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:39:58.380824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] validate_networks() for [('820ad496-e015-4103-bf1e-3aed07811aba', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:39:58.606171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:58.606979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:58.612939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.613429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.613863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.614571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.615031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.615456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.747480 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:58.755351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8a305c51-1976-4c42-88a3-01fc792cdaf5 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.152848 Oct 19 13:39:58.755949 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 262/516] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:58 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:39:58.836821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:39:58.837247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:39:58.837745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:39:58.838157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:39:58.838597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:39:58.847408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.847890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.848321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.849034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.849497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.849921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.866338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Getting quotas for project 4cb6b4edda314963acad175089204599. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:39:58.870415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Getting quotas for user 906899df35c14f9eb20415c513a8b599 and project 4cb6b4edda314963acad175089204599. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:39:58.881833 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:39:58.884110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85ea7524-6e95-48ee-a55f-2114d51da659',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:39:58.974979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-02f93df8-64cf-47a6-a6e6-dff47fd3a32e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652495 Oct 19 13:39:58.975628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 255/517] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:39:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:39:58.986539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1398b2db-3812-4dcf-9771-76aca39b407b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:58.987213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1398b2db-3812-4dcf-9771-76aca39b407b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:59.043833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1398b2db-3812-4dcf-9771-76aca39b407b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.050804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1398b2db-3812-4dcf-9771-76aca39b407b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1259 microversion: 2.1 time: 0.068086 Oct 19 13:39:59.051361 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 263/518] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:58 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:59.378843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:59.378843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:59.382246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.382792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.383233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.384063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.384536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.384959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.525697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.535771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.537948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.538811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6c7adb77-c362-402e-a36c-ca9262056c4b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.169531 Oct 19 13:39:59.539363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 256/519] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:39:59 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:39:59.780350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:59.780350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:59.787449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.788027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.788473 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.789278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.789628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.790055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.925616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.933563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-08cef75f-3e73-4385-a81d-a25be4bd8f47 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.159065 Oct 19 13:39:59.934122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 264/520] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:59 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:00.075355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:00.076539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:00.082965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.083486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.083967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.084706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.085255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.085707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.150889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:00.159047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-53d73b20-95c8-4716-909b-cc626f2be84a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1263 microversion: 2.1 time: 0.087568 Oct 19 13:40:00.159602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 257/521] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:00 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:00.565683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:00.566292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:00.572862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.573346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.573780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.574465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.574944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.575365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.699433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:00.707460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:00.708909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:00.710054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-89134cce-bcff-4edb-a354-c08bd1f742f1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.148328 Oct 19 13:40:00.710615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 265/522] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:00 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:00.956431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:00.957069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:00.962906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.963382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.963811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.964492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.964939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.965355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.094420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.102408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a8d3c457-47a8-46b1-9a7f-32d916486c39 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.149839 Oct 19 13:40:01.103103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 258/523] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:00 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:01.182203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:01.183127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:01.189736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:01.190619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:01.191211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.192194 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:01.192816 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:01.193391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.265482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.273197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-667ea605-a83a-427f-ab3e-f6fd20495cc3 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1263 microversion: 2.1 time: 0.095672 Oct 19 13:40:01.273747 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 266/524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:01 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:01.735063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:01.735603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:01.743892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:01.744376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:01.744806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.745503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:01.745955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:01.746378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.873622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.882094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.883563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.884706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-302f7cf2-2982-471a-ae6e-e87e10305253 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.153619 Oct 19 13:40:01.885259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 259/525] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:01 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:02.128823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:02.129438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:02.136046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.136727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.137161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.137848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.138299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.138748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.269803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:02.277436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1e3ca18a-e2a8-4973-aa50-46ab8f6b30f7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.154362 Oct 19 13:40:02.278000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 267/526] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:02 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:02.295822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:02.297181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:02.303054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.303790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.304224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.305109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.305559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.305982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.373157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:02.382525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b8fd2d7a-3c6a-44d3-949e-13a91ca52669 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1311 microversion: 2.1 time: 0.090409 Oct 19 13:40:02.383106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 260/527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:02 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:02.911138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:02.911740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:02.917732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.918206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.918672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.919345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.919792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.920210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.053675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.057065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.058533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.059680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dc3875e8-200b-4a76-9c2d-fd6db5511be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.152458 Oct 19 13:40:03.060225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 268/528] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:02 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:03.300104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:03.300711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:03.306875 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.307352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.307779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.308452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.308931 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.309348 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.405108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:03.405724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:03.412170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.412646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.413085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.413773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.414231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.414694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.439480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.447373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e1d1a3b1-a821-4c0a-93a9-0e0279d88ba4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.151152 Oct 19 13:40:03.448035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 261/529] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:03 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:03.484710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.491759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6ffcfd3f-5486-443e-99aa-730696d6236b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1311 microversion: 2.1 time: 0.090485 Oct 19 13:40:03.492311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 269/530] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:03 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:04.085786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:04.086486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:04.092517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.093762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.094426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.095278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.095995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.096181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.114242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:04.237606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.250307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.250307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.250307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-98f6733f-09c0-4dc4-bc67-25739430a274 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.167867 Oct 19 13:40:04.250821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 262/531] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:04 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:04.420364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be44629-963d-4b29-a35b-4d44167bc3a0", "name": "network-vif-plugged", "status": "completed", "tag": "b4081753-ab74-478c-8676-6cd09a91aa21"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:04.432203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.432681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.433292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.446682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] Creating event network-vif-plugged:b4081753-ab74-478c-8676-6cd09a91aa21 for instance 6be44629-963d-4b29-a35b-4d44167bc3a0 on hv-cinder-86188 Oct 19 13:40:04.453980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-dc26d7ee-d2f5-44f9-b1bf-c2fb359dff24 req-ca9615fc-ab57-427d-b167-8750f5abe805 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036950 Oct 19 13:40:04.454602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 270/532] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:04.471154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:04.471825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:04.480045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.480537 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.483340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.487113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.487113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.487566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.520107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:04.520829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:04.555479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.557212 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.557657 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.558370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.558853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.559787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.725383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.735279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2cd49917-0185-4711-8f95-0640e7c42876 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.268195 Oct 19 13:40:04.741194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 263/533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:04 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:04.741364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.747842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-231316c8-c1ee-484b-b142-4a72ceee5b0a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.236447 Oct 19 13:40:04.748537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 271/534] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:04 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:05.275691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:05.276225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:05.282909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.283400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.283840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.284548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.285042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.285467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.417217 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.425334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.426895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.428038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-30550228-4c45-42c7-8100-7488d891d85c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.156387 Oct 19 13:40:05.428843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 264/535] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:05 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:05.758612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:05.759777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:05.767017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.767699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.768143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.768846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.769305 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.769727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.772433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:05.773052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:05.779015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.779501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.779942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.780634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.781092 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.781536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.904634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.912777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f35830cf-69f6-4fae-acde-9a5e6182d1d3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.157944 Oct 19 13:40:05.930524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.931142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 272/536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:05 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:05.939778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7c0b5cac-80cf-490f-9af1-bf64783e552e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.171017 Oct 19 13:40:05.940426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 265/537] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:05 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:06.453220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:06.454045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:06.460292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.460890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.461392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.462149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.462699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.463217 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.466035 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:06.597284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:06.605287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:06.606759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:06.607904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-955b35e1-2807-4447-9294-d26d847231b1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.158575 Oct 19 13:40:06.609067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 273/538] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:06 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:06.937267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:06.938015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:06.945065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.945655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.946102 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.946836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.947323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.947743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.963423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:06.964201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:06.972072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.972653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.973165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.974081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.975070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.975826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:07.087796 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.096223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c114ae8f-5403-427b-b565-fc1930d344db tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.162859 Oct 19 13:40:07.096762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 266/539] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:06 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:07.125715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.135423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4ce96a0b-c1fd-455c-8935-e65e716ea274 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.175977 Oct 19 13:40:07.135999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 274/540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:06 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:07.633456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:07.634091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:07.641435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:07.642019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:07.642689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:07.643561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:07.644136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:07.644567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:07.776101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.784870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.786511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.787687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e940dc90-3f09-49ae-aa5d-642d5dd7a489 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.158367 Oct 19 13:40:07.788433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 267/541] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:07 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:08.118872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:08.119463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:08.125815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.126277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.126775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.127456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.127907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.128327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.159085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:08.159706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:08.165672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.166152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.166609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.167298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.167750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.168170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.269618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.277635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5fff0ab6-202c-42fa-b076-5f9f46778e62 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.162548 Oct 19 13:40:08.278208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 275/542] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:08 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:08.318157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.326244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-53d962bb-d205-49de-9a52-fd80cfe0ee44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.171611 Oct 19 13:40:08.326866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 268/543] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:08 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:08.814552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:08.825896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:08.825896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.825896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.825896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.826277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.826277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.826277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.974016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.984170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.985642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.986825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2d9a019e-f2c7-4e15-a25a-bd7a65b09a42 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.176775 Oct 19 13:40:08.990344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 276/544] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:08 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:09.302205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:09.302872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:09.304911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:09.305585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=10 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:09.310274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.310802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.311360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.311967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.312413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.312833 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.349696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:09.351044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:09.374916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:09.386406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.387892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.388357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.389112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.389810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.390456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.499868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:09.508331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f87bb47a-3dd1-404b-a6ac-bc5d41cf06c4 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.209912 Oct 19 13:40:09.509216 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 269/545] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:09 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:09.562602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:09.570575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6c3ef0e6-10ab-4f97-9bff-d85af5befa44 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.224738 Oct 19 13:40:09.571176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 277/546] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:09 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:10.013573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:10.016369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:10.022984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.023473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.023951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.024591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.025041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.025463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.169767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.184517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.184517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.184517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-440622c2-6c51-4acc-9741-c64080ae2481 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.171957 Oct 19 13:40:10.184791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 270/547] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:10 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:10.531678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:10.532303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:10.539076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.539558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.539992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.540672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.541123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.541547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.599088 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:10.599693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:10.605535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.606017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.606453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.607170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.607620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.608533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.668861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.677009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c1842432-a161-4a47-9a0f-43fd4cc0c28f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.149186 Oct 19 13:40:10.677588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 278/548] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:10 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:10.732472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.740721 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0453c782-7f80-40d4-ae7b-b018d9e8fc99 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.145520 Oct 19 13:40:10.741282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 271/549] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:10 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:11.208138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:11.208663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:11.214913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.215396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.215956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.216670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.217127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.218104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.356840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.365719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.367206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.368580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a2361776-701b-4acf-8720-14d3b4113db0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.164527 Oct 19 13:40:11.369180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 279/550] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:11 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:11.700568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:11.701179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:11.707852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.708334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.708773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.709458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.709912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.710335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.764379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:11.766274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:11.773955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.774441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.774903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.775610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.776066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.776489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.844780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.852408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2a3e6e49-0290-4ef4-b75f-aced0899d794 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.155746 Oct 19 13:40:11.853082 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 272/551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:11 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:11.903714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.911378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-223c107e-c6fe-43f6-9c11-c310bf18b434 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.151429 Oct 19 13:40:11.911946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 280/552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:11 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:12.393257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:12.393866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:12.399775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.400253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.400688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.401368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.401819 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.402238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.532950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:12.544719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:12.544719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:12.544719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-438caf8d-3342-477e-8bd8-95e949067751 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.154456 Oct 19 13:40:12.545072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 273/553] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:12 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:12.874988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:12.875637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:12.882086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.882603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.883042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.883727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.884183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.884609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.934350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:12.935639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:12.942038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.945997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.945997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.945997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.945997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.946341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:13.026352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.034553 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a5f13083-a9fa-414a-8b8e-a9ca5d16abdf tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.163473 Oct 19 13:40:13.037700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 281/554] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:12 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:13.084245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.092074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-29ccc7fb-2995-49dc-8b19-a05371a5162e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.161476 Oct 19 13:40:13.092690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 274/555] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:12 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:13.570884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:13.571509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:13.578560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:13.579074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:13.579504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:13.580240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:13.580705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:13.581138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:13.720291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.728338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.729776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.730960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-56a9076a-6440-4918-afec-b0833aab1b60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.164127 Oct 19 13:40:13.731515 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 282/556] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:13 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:14.057869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:14.058494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:14.064496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.064982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.065421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.066113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.066634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.067030 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.115477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:14.116381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:14.123358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.124191 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.125141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.126377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.127108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.127743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.261979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.270731 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1b7b0275-4a92-4858-af4c-ca1a6c21b4d1 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.216729 Oct 19 13:40:14.271289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 275/557] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:14 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:14.275398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.284112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-429cf181-401d-4ab0-a206-78182fe17032 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.172577 Oct 19 13:40:14.284665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 283/558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:14 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:14.757456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:14.758065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:14.764727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.765221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.765651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.766326 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.766799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.767219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.898093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.906307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.907892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.909035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-44e9c322-2647-4ac9-a47e-10a77631f2bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.155600 Oct 19 13:40:14.909591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 276/559] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:14 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:15.302061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:15.303870 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:15.307255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:15.308199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:15.312428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.313101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.313549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.314432 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.315156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.315777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.317782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.323208 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.323755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.324665 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.325207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.325707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.461039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:15.470388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-017c7153-3ee4-49ec-b320-2a4ce5d53e1d tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.180974 Oct 19 13:40:15.470992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 284/560] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:15 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:15.485801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:15.488130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1448268729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-857404674", "security_groups": [{"name": "tempest-secgroup-smoke-2085292027"}], "block_device_mapping_v2": [{"uuid": "f8987f0e-665d-4d3c-8e3a-83e346b021d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac"}]}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:15.497156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bede1eb2-bdcd-4559-8cc0-e270f9fcbb0b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.194191 Oct 19 13:40:15.498949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 277/561] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:15 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:15.629231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] validate_networks() for [('11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:40:15.937792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:15.938400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:15.944696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.945403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.946037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.946932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.947797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.948398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.077625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:40:16.078154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:40:16.078760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:40:16.079614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:40:16.080200 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:40:16.080518 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.088930 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.089926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.090420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.090712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.091146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.091583 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5b3443f1-2cec-4751-9f46-cc7097dbda1e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.158630 Oct 19 13:40:16.092036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.092626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 278/562] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:15 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:16.093016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.093505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.111376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:40:16.115865 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for user e7a6ae7333d2422ebc9f616d482e527a and project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:40:16.174401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:40:16.176715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8987f0e-665d-4d3c-8e3a-83e346b021d2',volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:40:16.498984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:16.499691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:16.505839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.506402 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.507035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.507985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.508701 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.509382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.515020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:16.611295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-493c0ab8-95ac-4710-9764-7619b7622e4f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.126848 Oct 19 13:40:16.612001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 285/563] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:40:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 13:40:16.618530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:16.619695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:16.626691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.627482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.627976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.628879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.629669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.630272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.650071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.667042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4d0ec789-7826-4446-8099-22e0270e9720 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.172149 Oct 19 13:40:16.668315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 279/564] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:16 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:16.673264 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-da13081a-d74c-4b65-a1d3-c76830c84a3a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:16.674205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-da13081a-d74c-4b65-a1d3-c76830c84a3a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:16.680018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:16.737268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-da13081a-d74c-4b65-a1d3-c76830c84a3a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.745244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-da13081a-d74c-4b65-a1d3-c76830c84a3a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1094 microversion: 2.1 time: 0.075663 Oct 19 13:40:16.745817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 280/565] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:16 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:16.812198 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.820268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c2af4983-4ff1-4920-8204-0cb68baad466 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.207000 Oct 19 13:40:16.836957 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 286/566] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:16 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:17.117884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:17.118957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:17.125774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.126258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.126727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.127428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.127880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.128333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.270425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.279602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.281046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.282195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a83eca18-9e10-4a4d-a03b-5a0338965e6d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.168268 Oct 19 13:40:17.282763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 281/567] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:17 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:17.689165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:17.689762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:17.696137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.696610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.697041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.697717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.698163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.698609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.769182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:17.769817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:17.775663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.776139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.776569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.777249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.777701 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.778118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.825972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.833850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-df30fa77-271c-4510-b5e5-d0ec27b3848f tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.148561 Oct 19 13:40:17.834422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 287/568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:17 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:17.838117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.843938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:17.844548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:17.847095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-61a90978-a905-4be6-afd3-f9aec8f19bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.081829 Oct 19 13:40:17.848119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 282/569] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:17 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:17.850565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.851050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.851486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.852176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.852631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.853058 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.978580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.986127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-21c4364e-a3e7-4ae3-96eb-54e5ec098b29 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.146505 Oct 19 13:40:17.986721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 288/570] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:17 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:18.308002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:18.308605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:18.315090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.315561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.315988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.316657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.317104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.317514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.450026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:18.458689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:18.460125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:18.461276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5121d09e-8eb8-48c0-80b3-0ebd0cc742c1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.157160 Oct 19 13:40:18.461829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 283/571] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:18 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:18.859035 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:18.859656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:18.870607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:18.871309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:18.872684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.873199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.874164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.874978 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.875508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.876011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.878850 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.879438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.879964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.880760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.881310 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.881957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.949707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:18.957514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ccaf1284-b1ed-4ea1-b5e1-574ff4831036 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.090744 Oct 19 13:40:18.961249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 284/572] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:18 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:19.009336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:19.009601 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:19.015684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.016171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.016599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.017500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.017959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.018378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.023829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.033015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-00e4748c-c5f2-4897-85fa-80437dae0179 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.179252 Oct 19 13:40:19.033842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 289/573] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:18 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:19.151783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.160203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-52d3df09-4cb1-4a58-8313-f230807a1964 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.154985 Oct 19 13:40:19.160863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 285/574] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:19 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:19.486885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:19.487422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:19.493364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.493846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.494281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.494994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.495450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.495873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.518557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:19.635233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.643714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.645161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.646318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2eb07626-d9b7-42f5-a6ff-aa56e3036a80 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.163627 Oct 19 13:40:19.646983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 290/575] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:19 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:19.979463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:19.980052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:19.986042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.986531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.986986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.987664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.988132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.988532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.050990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.056218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:20.064406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:20.064523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3a0c17a7-f5dc-4ebc-8960-ea5052f7e8a4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.083398 Oct 19 13:40:20.064523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 286/576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:19 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:20.064688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.064688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.064688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.065311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.065757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.066179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.183392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:20.184263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:20.192245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.195250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.195250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.195250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.195250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.195599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.214974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.223610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7e1eae2a-1909-4ce0-b9d0-10c09cd47797 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.171346 Oct 19 13:40:20.224190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 291/577] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:20 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:20.329340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.336872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-61fee433-e175-4b56-a1a8-078a0ca6ec4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.158012 Oct 19 13:40:20.337424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 287/578] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:20 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:20.671755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:20.672366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:20.674213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:20.679159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.679911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.680352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.681040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.681579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.682017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.806345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.814877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.816306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.817447 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5c84de58-5dbb-449c-adfc-243defc0dbe8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.149687 Oct 19 13:40:20.817994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 292/579] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:20 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:21.082632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:21.083245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:21.089181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.089657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.090092 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.090793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.091246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.091665 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.149392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.156886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d4f3654a-cdc5-4d59-9b40-99c8dacba691 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.078183 Oct 19 13:40:21.157442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 288/580] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:21 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:21.246844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:21.247587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:21.254746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.255225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.255736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.256444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.256848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.257273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.360162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:21.360768 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:21.366594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.367076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.367508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.368256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.368693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.369110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.382095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.389822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-16acf094-4b97-45cf-a6b0-131f6ad7f542 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.146821 Oct 19 13:40:21.390386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 293/581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:21 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:21.495574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.503017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-226007b7-940e-4993-9958-75a7992bb864 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.147273 Oct 19 13:40:21.503573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 289/582] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:21 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:21.843609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:21.844214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:21.850060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.850555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.850987 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.851661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.852107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.852526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.981123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.989005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.990437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.991599 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5b3f2c49-fada-4885-a559-c0500098fecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.152472 Oct 19 13:40:21.992145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 294/583] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:21 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:22.179791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:22.180393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:22.186860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.187282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.187712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.188380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.188824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.189237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.247232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:22.255109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d44de9b7-e0fe-4692-b8ef-6b9e54c804c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.079377 Oct 19 13:40:22.255654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 290/584] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:22 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:22.412453 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:22.413054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:22.419352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.419831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.420749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.421431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.421880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.422300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.525234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:22.525951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:22.532079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.532564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.533029 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.533712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.534165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.534608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.547185 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:22.555053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b3d22041-8e68-493b-a9d7-da6338883203 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.146481 Oct 19 13:40:22.555615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 295/585] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:22 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:22.658633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:22.666121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4c648874-7541-4257-ac93-a9e77e264189 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.144733 Oct 19 13:40:22.666698 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 291/586] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:22 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:23.016232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:23.016848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:23.022894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.023374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.023806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.024487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.024942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.025367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.152605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.161170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.162636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.163789 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4c0f9055-b1f3-4ca9-ae7b-1b9d540706d1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.151449 Oct 19 13:40:23.164344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 296/587] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:23 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:23.279046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:23.280186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:23.286144 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.286665 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.287095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.287786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.288213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.288624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.350013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.357533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2890eee2-c963-4733-8368-d558492898f5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.082350 Oct 19 13:40:23.358101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 292/588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:23 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:23.578648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:23.579265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:23.585596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.586082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.586533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.587220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.587677 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.588102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.689622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:23.690354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:23.696169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.696645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.697073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.697754 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.698200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.698639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.715170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.722771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-705ac932-4090-4fe0-81f8-ef338f9320b3 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.148680 Oct 19 13:40:23.723341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 297/589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:23 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:23.823039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.831214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e83b9c7d-2088-4a64-9a22-a197955603e8 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.145964 Oct 19 13:40:23.831713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 293/590] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:23 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:24.190237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:24.190955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:24.196951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.197429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.198000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.198724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.199207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.199632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.330255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.339136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.340620 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.342227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-08cb4ffc-af87-4c4f-8c81-2dcfb4bb5a39 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1743 microversion: 2.20 time: 0.156305 Oct 19 13:40:24.343188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 298/591] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:24 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:24.380246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:24.380910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:24.387044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.387547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.387973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.388681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.389129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.389545 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.449996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.457544 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-488018e5-8336-4a46-a52d-707d906792b3 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1144 microversion: 2.1 time: 0.081279 Oct 19 13:40:24.458099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 294/592] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:24 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:24.745218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:24.745772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:24.752179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.752664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.753097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.753782 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.754264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.754720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.853045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:24.853656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:24.859688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.860168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.860600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.861282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.861726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.862141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.889819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.897478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-63922714-7e39-4ac9-9331-29413dd7a2e7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.156203 Oct 19 13:40:24.898046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 299/593] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:24 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:24.991180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.999405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5b8a86c2-b955-4166-a1a6-67900e59a148 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.150056 Oct 19 13:40:24.999904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 295/594] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:24 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:25.369686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:25.370480 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:25.377663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.378279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.378811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.379563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.380131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.380731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.480387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:25.481014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:25.487700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.488181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.488606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.489424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.489764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.490179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.552898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:25.555102 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:25.562036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-16c97835-35ee-42f8-8d96-0b76cf35f6df tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1136 microversion: 2.1 time: 0.085532 Oct 19 13:40:25.562781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 296/595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:25 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:25.585911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:25.602103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:25.603571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:25.604714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3300639b-560e-4823-954a-94b44d987668 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.239454 Oct 19 13:40:25.605259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 300/596] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:25 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:25.920997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:25.921608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:25.928155 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.928635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.929170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.929856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.930304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.930757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.072942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.083131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-54f660c5-0e53-4899-915e-d367d0a9d860 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.166320 Oct 19 13:40:26.090680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:26.100835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 297/597] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:25 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:26.101218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.101881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.102335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.106414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:26.108068 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:26.108182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:26.113912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.114396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.114556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] Creating event network-changed:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:40:26.114891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.115581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.116033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.116452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.119544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-a9d56669-dffe-480c-9df7-a59eb3589a5f req-b03029ba-661b-478c-8dfc-787c639429c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109249 Oct 19 13:40:26.120124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 301/598] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:40:26.251069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.259774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-67971405-b598-4e9a-bce7-6092c90d813c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.157649 Oct 19 13:40:26.260332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 298/599] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:26 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:26.581287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:26.585748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:26.591675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:26.593440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.594115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.594584 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.595481 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.595932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.596526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.630105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:26.631895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:26.637317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.637803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.638232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.639610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.640286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.640704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.674527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.692622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7a653992-464a-4a57-96a6-5f88461c68b2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1192 microversion: 2.1 time: 0.112303 Oct 19 13:40:26.693212 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 302/600] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:26 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:26.741648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:26.789101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.797560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.799033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.800331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bcc6427e-0273-4ea1-b4bf-128bea6f810c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.174042 Oct 19 13:40:26.800896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 299/601] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:26 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:27.108416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:27.109125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:27.116033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.116513 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.117047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.118315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.119211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.120111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.262750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:27.272587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-42876aa0-fd9b-4efb-99ce-55fd9b727706 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.168190 Oct 19 13:40:27.273190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 303/602] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:27 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:27.283613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:27.284228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:27.290097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.290605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.291035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.291707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.292151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.292625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.436886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:27.456667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5d456c86-143a-463c-9201-8c8fce646e04 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.176927 Oct 19 13:40:27.457621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 300/603] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:27 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:27.724037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:27.724648 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:27.733415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.733938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.734374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.735146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.735773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.736347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.814889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:27.825682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4df17abb-68be-477b-af1a-41d4c79ae71f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1192 microversion: 2.1 time: 0.105690 Oct 19 13:40:27.826531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:27.827313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:27.833664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.834272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.834803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.835596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:27.836174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:27.836745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:27.839870 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 304/604] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:27 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:27.990674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.010825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.012866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.014542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8781d22f-82e3-40aa-b54d-8536c696e986 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.192259 Oct 19 13:40:28.031302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 301/605] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:27 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:28.296994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:28.297871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:28.305475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.306010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.306651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.307531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.308194 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.308953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.463328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.472457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2df01ac5-3720-4579-8fa5-0cfedd70f63b tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1319 microversion: 2.1 time: 0.180100 Oct 19 13:40:28.473060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 305/606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:28 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:28.480925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:28.481540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:28.487967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.488449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.488881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.489566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.490047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.490470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.640488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.648464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-333ab670-c10d-4f11-bdc8-e75cd8ccb101 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.171273 Oct 19 13:40:28.655137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 302/607] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:28 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:28.852687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:28.852687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:28.866149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.866813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.867327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.868291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.869009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.869509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.041431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:29.042769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:29.055253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.058926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.059503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.060098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.060607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.061221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.205047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.214532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-33956d39-b350-4d98-9688-026385cabc1b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1192 microversion: 2.1 time: 0.368000 Oct 19 13:40:29.217195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 306/608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:28 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1192 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:29.251977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.261243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.264505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.265996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4541f549-057d-4cb5-a8fd-de292c43d595 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.228565 Oct 19 13:40:29.278591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 303/609] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:29 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:29.495642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:29.496868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:29.504656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.505384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.506059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.506942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.507537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.508119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.672004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:29.673631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:29.689243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.690028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.690841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.691921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.692561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.693182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.862826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.862826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:29.862826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f11b7779-504b-412e-bbc7-936412ef28a7 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1507 microversion: 2.1 time: 0.369311 Oct 19 13:40:29.862826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 307/610] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:29 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:29.887916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb8c0ad-1df9-44c5-8b73-6949fc8a1a08", "device": "/dev/sdb"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:29.892156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:29.899977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.900525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.901011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.901928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.902341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.902826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.903027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.916267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2ee93509-0bbd-480e-836c-f39a1c6dd8ec tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.248188 Oct 19 13:40:29.917226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 304/611] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:29 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:30.239140 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:30.240413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:30.246677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.247151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.247576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.248895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.249339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.249780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.313372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:30.321157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1b44dcaa-73f0-4c12-b64a-51ac9dbc44c5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1210 microversion: 2.1 time: 0.085799 Oct 19 13:40:30.321719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 305/612] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:30 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:30.326349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:30.326969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:30.332933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.333410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.334348 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.334620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.335105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.335525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.527595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:30.537386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:30.539261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:30.540608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e82cb890-1bce-4971-9f5c-a40e245ccaaf tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.217986 Oct 19 13:40:30.541334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 306/613] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:30 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:30.965737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:30.966351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:30.980678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.981475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.982069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.982984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.983607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.984176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.175600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.184433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-743e6c33-dbfc-4bc1-b29e-368779fe8d28 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.222783 Oct 19 13:40:31.184998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 307/614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:30 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:31.344967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:31.345643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:31.351855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.352272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.352707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.353592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.354047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.354813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.515460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.525330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5b699295-9dfe-4c9b-9732-5d29754459ca tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1278 microversion: 2.1 time: 0.184541 Oct 19 13:40:31.526190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 308/615] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:31 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:31.567779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:31.568587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:31.574985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.575464 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.575890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.576562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.577005 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.577455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.720580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.734269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.736579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.738007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-422a83fb-3de1-4068-bdb9-71161e17a88c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.174061 Oct 19 13:40:31.751710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 309/616] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:31 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:32.210210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:32.210947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:32.217853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.218389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.218908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.219710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.220226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.220712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.580597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.588704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9c40b371-b8ca-4acd-9d99-994285652b7b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.382572 Oct 19 13:40:32.589336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 310/617] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:32 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:32.593852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:32.594567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:32.600173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.600642 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.601067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.601733 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.602174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.602617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.745938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.754615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-490fd8c9-c51f-42ad-8f12-94e1de216b0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1278 microversion: 2.1 time: 0.164081 Oct 19 13:40:32.755182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 311/618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:32 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:32.767885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:32.770330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:32.777659 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.778148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.778624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.779342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.779866 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.780308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.953730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.963703 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.965304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.966725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fe323063-6b94-4899-9b64-7dc7665f4428 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.203969 Oct 19 13:40:32.967888 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 312/619] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:32 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:33.613255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:33.615311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:33.622010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.622501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.624482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.625462 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.627024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.627442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.647249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:33.788474 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:33.800502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-79e0f58a-ba22-479c-b726-d9e60fe5e3bb tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.192726 Oct 19 13:40:33.801194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 313/620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:33 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:33.806331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:33.807169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:33.814020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.814785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.815426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.816379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.817099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.817743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.958287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:33.967029 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c3cbf4fc-5ca2-42d4-b0b8-bf00f272a0ff tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1278 microversion: 2.1 time: 0.164414 Oct 19 13:40:33.968219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 314/621] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:33 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:33.993605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:33.994393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:34.025986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.026620 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.027058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.027765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.028214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.028632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.193555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:34.202459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:34.226695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:34.226695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3fc7a57e-6e2a-4959-a155-4b784c2fef7f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.215642 Oct 19 13:40:34.226695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 315/622] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:33 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:34.827172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:34.827867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:34.833906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.834388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.834852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.835534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.835985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.836404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.987222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:34.996086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f9c75f5c-d04d-455c-84b9-44e17f001c4c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.172825 Oct 19 13:40:34.996933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 316/623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:34 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:35.002373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:35.003449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:35.018922 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.019415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.019854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.020555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.021004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.021426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.173709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:35.182703 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-586e81b1-14f0-4d10-bd0b-98e765331dfd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1278 microversion: 2.1 time: 0.184414 Oct 19 13:40:35.183746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 317/624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:34 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:35.251020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:35.251627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:35.258381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.258892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.259337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.260115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.260567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.261881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.410146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:35.421091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:35.422485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:35.423700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dcd157dc-26d4-47a6-8c69-efef1575185c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.178356 Oct 19 13:40:35.438592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 318/625] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:35 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:36.006707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-02d1bf73-2e7c-4045-b61c-376336ae87c2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "POST /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.125009 Oct 19 13:40:36.024777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:36.034367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:36.041783 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 308/626] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:40:29 2022] POST /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0/os-volume_attachments => generated 194 bytes in 6161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:36.049294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.055663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.056311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.057377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.057989 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.058605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.208749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:36.209737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:36.225456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.226203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.226851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.228061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.228667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.229263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.256976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:36.271165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-acac36a2-686b-48f0-9332-ea41d000e3d1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.251621 Oct 19 13:40:36.278149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 319/627] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:36 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:36.458237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:36.458889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:36.465819 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.466582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.467180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.468109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.468889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.469323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.492643 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:36.506949 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-db16feba-97f7-483f-ada2-5fd5712c3517 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.302232 Oct 19 13:40:36.508297 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 309/628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:36 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:36.652228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:36.665777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:36.668480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:36.671189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-24832639-85c1-4af1-97ec-88ed9af15867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.216519 Oct 19 13:40:36.672891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 320/629] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:36 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:36.707912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5530fa5a-76ad-4149-99bd-909c686e1e79", "tag": "77511b14-976b-4336-8b31-a9eb1f588505"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:36.726761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.727655 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.728263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.740379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] Creating event network-changed:77511b14-976b-4336-8b31-a9eb1f588505 for instance 5530fa5a-76ad-4149-99bd-909c686e1e79 on hv-cinder-86188 Oct 19 13:40:36.746134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-67af7817-b76e-43a0-9b96-f8777ac31a9f req-cadb2d3b-6bf5-4691-bb64-cf8846b69838 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042238 Oct 19 13:40:36.747564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 310/630] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:37.242859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "name": "network-vif-plugged", "status": "completed", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:37.254886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.255171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.255790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.268374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] Creating event network-vif-plugged:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:40:37.273365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-3538b9c4-b334-4f18-8078-f2438123867c req-4262237a-4231-42b8-8b77-f9f4e1726a24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100020 Oct 19 13:40:37.274459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 321/631] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:37.302489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:37.303395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:37.318251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.318931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.319531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.320927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.322287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.325078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.474598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.489151 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-afd3e845-9a0e-426d-a1a5-0a27d306bd40 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.191505 Oct 19 13:40:37.489712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 311/632] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:37 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:37.538161 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:37.539040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:37.546009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.546494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.546990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.547943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.548396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.549026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.694360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.698113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:37.698304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:37.713604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-86f4e601-8ecc-4538-b702-8b9b1c79f9a7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.168884 Oct 19 13:40:37.713604 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 322/633] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:37 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:37.720808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.721605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.722221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.722973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:37.723593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:37.724025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:37.871891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.880440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.881869 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.883043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-998f6fad-3f0d-4480-a2e5-6781e9924463 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.189536 Oct 19 13:40:37.883729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 312/634] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:37 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:38.512190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:38.513417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:38.520754 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.521438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.522046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.522766 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.523364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.523935 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.665016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:38.673622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8e2e615e-8059-4963-bee5-13bd94c80916 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.165087 Oct 19 13:40:38.674392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 323/635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:38 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:38.725152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:38.725746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:38.732303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.732822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.733268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.733955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.734409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.734871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.881887 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:38.891037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c91bc457-5e00-43ba-82ef-cfe11699b469 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.169452 Oct 19 13:40:38.891610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 313/636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:38 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:38.910255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:38.910879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:38.918760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.918760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.918760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.918760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.919185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.919629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.065750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:39.074587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:39.076011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:39.077667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-49c2cfaa-0b97-4be7-99c6-2c354d730aff tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.173422 Oct 19 13:40:39.078220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 324/637] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:38 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:39.697009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:39.697612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:39.703519 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.703993 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.704425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.705100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.705546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.705963 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.830765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:39.838340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-486ea2e3-1ad7-4051-9017-fc6c803ba580 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.145154 Oct 19 13:40:39.838933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 314/638] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:39 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:39.913679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:39.914290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:39.920675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.921160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.921593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.922271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.922751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.923176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.054700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:40.062207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d9f86b3f-3460-4854-93cd-f0d910be130b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.152336 Oct 19 13:40:40.065435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 325/639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:39 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:40.103263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:40.103873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:40.110449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.111098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.111542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.112235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.112687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.113112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.236161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:40.244628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:40.246071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:40.247249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5d5e876c-c284-49c9-80e6-c5439626d93f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.147995 Oct 19 13:40:40.247804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 315/640] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:40 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:40.860818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:40.861355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:40.867382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.867859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.868294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.868969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.869417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.869836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.992921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.000972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ed108ab0-d2d5-4cc5-8c63-754fb63c705f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.144020 Oct 19 13:40:41.001536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 326/641] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:40 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:41.084813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:41.085427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:41.091794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.092273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.092710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.093397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.093860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.094282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.222925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.230535 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cd5c1ae0-c7bd-46d3-8702-76c5bbf9383e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.149495 Oct 19 13:40:41.231091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 316/642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:41 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:41.273023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:41.273664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:41.279603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.280084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.280516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.281227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.281677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.282098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.431892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.442615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.444079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.445350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fadd74b7-c8bd-495a-b464-bd0eb9e1e6b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.176187 Oct 19 13:40:41.445902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 327/643] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:41 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:42.023973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:42.024616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:42.031282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.031769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.032210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.032904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.033364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.033791 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.211387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.219573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e4f9154b-aca6-4676-b638-5a4d004639c1 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.199469 Oct 19 13:40:42.220133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 317/644] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:42 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:42.253566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:42.254179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:42.260170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.260650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.261083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.261769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.262225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.262691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.392624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.400330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4452ee15-fbb0-44c8-bc2d-8c5d28d48f46 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.150624 Oct 19 13:40:42.400898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 328/645] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:42 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:42.470386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:42.473516 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:42.477016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.477488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.477919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.478666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.479119 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.479537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.608757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.618554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.618554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.619577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6f7e0d78-c6fa-43ef-94c8-cc52412bd812 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.153082 Oct 19 13:40:42.620137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 318/646] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:42 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:43.242419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:43.242976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:43.244968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:43.249848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.250322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.250773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.251449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.251896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.375526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.383090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-560c1e0a-3d22-4814-9dff-f1210008c755 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.144726 Oct 19 13:40:43.383649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 329/647] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:43 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:43.421500 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:43.422110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:43.428800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.429273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.429701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.430377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.430851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.431273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.559721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.567430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1af4ab6c-9dbc-421b-b9e9-cec762993f28 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.149753 Oct 19 13:40:43.572266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 319/648] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:43 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:43.646100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:43.646752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:43.652679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.653159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.653589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.654944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.655467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.655891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.784783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.786380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:43.793169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.794628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.795793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-30e04f4a-bd8b-4bd6-bec5-b0e5c74d4a38 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1738 microversion: 2.20 time: 0.153711 Oct 19 13:40:43.796352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 330/649] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:43 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:44.405598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:44.406238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:44.412155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.412640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.413079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.413762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.414216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.414667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.540338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.548524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d237de43-800d-4dac-a557-01de537fb022 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.146821 Oct 19 13:40:44.550166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 320/650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:44 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:44.593864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:44.594491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:44.600658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.601136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.601917 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.602241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.602718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.603139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.729977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.738187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-529cee29-f583-4f44-b555-a800988a9e80 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.148952 Oct 19 13:40:44.738785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 331/651] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:44 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:44.822015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:44.822652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:44.829046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.829525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.829961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.830723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.831165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.831590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.959278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.967296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.969403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.970583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-44517000-bc99-43ef-bdc7-1747546eccb9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1720 microversion: 2.20 time: 0.152517 Oct 19 13:40:44.971134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 321/652] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:44 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:45.572007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:45.572628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:45.578780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.579258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.579683 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.580447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.580894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.581307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.712052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:45.718764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-015f1195-5d01-4037-bd1b-f5e8f9a96688 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1359 microversion: 2.1 time: 0.150674 Oct 19 13:40:45.719322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 332/653] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:45 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:45.760840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:45.761454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:45.768141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.768626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.769061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.769860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.770318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.770776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.903485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:45.912125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2f9e7595-03d1-4882-885b-13afdc7f3a70 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.155268 Oct 19 13:40:45.912744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 322/654] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:45 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:45.995985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:45.996589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:46.003091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.003550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.004003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.004679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.005135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.005560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.140630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:46.148562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:46.149970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:46.151138 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-96d5af81-0cd0-45fa-a8ac-76330d58a915 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1720 microversion: 2.20 time: 0.159181 Oct 19 13:40:46.151680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 333/655] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:45 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:46.741055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:46.741673 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:46.747684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.748166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.748600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.749284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.749739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.750162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.935550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:46.936167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:46.942181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:46.944699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.947748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.947748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.947748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.947748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.948418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.951163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:46.953793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6073dc4d-2ec3-4bf0-9f70-2edfe78ad103 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1550 microversion: 2.1 time: 0.216561 Oct 19 13:40:46.970567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 323/656] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:46 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1550 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:46.976631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:46.977550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:46.983948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.984587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.985125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:46.986697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:46.987256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:46.987896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.098160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.105915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0d23ee3a-ac0a-40dd-8597-6a6d6f4b9e79 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.174219 Oct 19 13:40:47.106476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 334/657] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:46 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:47.111007 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "name": "network-vif-unplugged", "status": "completed", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:47.120825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.121357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.121785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.130917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.133319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] Creating event network-vif-unplugged:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:40:47.138501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-0f2c4dbb-92fb-43b8-b6d1-aa9c82201957 req-a3b79bec-ddba-4225-bc4b-0722f5e12f0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030856 Oct 19 13:40:47.138682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-034d2c4a-e9e3-4d2e-aef1-e826a0047a2e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1550 microversion: 2.1 time: 0.165665 Oct 19 13:40:47.139115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 324/658] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:46 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:47.140598 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 335/659] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:47.161261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:47.166176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.166965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Searching by: {'deleted': False, 'project_id': '4cb6b4edda314963acad175089204599'} {{(pid=125749) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 13:40:47.173710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.174405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.175056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.175927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.176539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.177390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.178354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:47.179206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:47.185967 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.186545 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.186913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.187615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.188070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.188498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.270232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.multi_cell_list [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125749) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 13:40:47.330909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.339078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.340674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.341810 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e0db4b55-6c7c-4ea5-9aaa-389c83c3bf30 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1720 microversion: 2.20 time: 0.168581 Oct 19 13:40:47.342364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 336/660] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:47 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:47.367994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e0bb36b1-91b6-4df4-8be9-e71f60150996 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211266 Oct 19 13:40:47.368564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 325/661] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Oct 19 13:40:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:47.380306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:47.381022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:47.387051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.387525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.387952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.388622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.389067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.389483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.514380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.522564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6466eb2b-b1dd-48ad-8e09-4d90df92616c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1550 microversion: 2.1 time: 0.146272 Oct 19 13:40:47.523122 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 337/662] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:47 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:48.128972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:48.129579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:48.137099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.137588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.138015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.138918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.139373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.139802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.293665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:48.301540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-56ffa644-87a0-43de-9e88-ae32a26911a5 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.176510 Oct 19 13:40:48.302304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 326/663] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:48 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:48.368315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:48.369359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:48.375956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.377072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.377570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.378485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.379158 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.379814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.540876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:48.550031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:48.551739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:48.553381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4a11eef6-6e04-4d4a-836c-c09e59965730 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1723 microversion: 2.20 time: 0.189007 Oct 19 13:40:48.554337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 338/664] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:48 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:48.579275 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31468061-774e-4ae8-936e-72cb412b3418"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:48.582305 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:48.588406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.589070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.592004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.592004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.592004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.592004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.324628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:49.325191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:49.331276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.331760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.332192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.336288 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.336288 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.336288 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.467822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:49.475597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-85ab4962-d3e1-4e87-ad36-91b117e875e9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.154881 Oct 19 13:40:49.476157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 339/665] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:49 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:49.731159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4236bb39-ec51-443a-a00f-96cc9ce2fead tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.156231 Oct 19 13:40:49.731817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 327/666] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Oct 19 13:40:48 2022] POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments => generated 188 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:40:49.855171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:49.855759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:49.861844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.862319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.862785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.863457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.863935 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.864349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.907617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125748) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 13:40:50.185653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e40ad3f2-d19b-4e1b-b519-fdcb568d33fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action" status: 202 len: 0 microversion: 2.20 time: 0.334174 Oct 19 13:40:50.186211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 340/667] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 13:40:49 2022] POST /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:40:50.195077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:50.195684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:50.202821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.203298 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.203728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.204638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.205091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.205521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.342061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:50.351219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:50.352897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:50.354258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3fd48d2f-f9f8-4c86-b925-7c1516541221 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1749 microversion: 2.20 time: 0.163220 Oct 19 13:40:50.355296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 328/668] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:50 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:40:50.486633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:50.489234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:50.495661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.496136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.496664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.497369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.497815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.498279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.498439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:50.499570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:50.514501 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.515032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.515629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.516331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.516787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.517211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.668603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:50.678177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aaf3823b-f992-4ee0-a7f2-dc41b575eeda tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.183530 Oct 19 13:40:50.691335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 329/669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:50 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:51.268224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-22584009-f4e8-4cc9-ab2d-72a181f5b25a tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785293 Oct 19 13:40:51.269010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 341/670] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:40:50 2022] POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:51.381859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:51.382535 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:51.384820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=76 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:51.389842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.390496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.390989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.391740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.392727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.393152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.525625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:51.534410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:51.535911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:51.537057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d4b34efa-86cc-4746-9b3f-75be39c99487 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1749 microversion: 2.20 time: 0.159107 Oct 19 13:40:51.537606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 330/671] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:51 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:51.701559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:51.702257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:51.708540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.709019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.709452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.710130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.710690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.711101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.840707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:51.848332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7dc5f2fe-630f-4c3b-a522-f77f0757ed44 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.151393 Oct 19 13:40:51.848887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 342/672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:51 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:52.563003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:52.563610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:52.569923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.570403 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.570888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:52.571564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.572021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.572442 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:52.695504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:52.703911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:52.706003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:52.707183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c97de1ba-a452-4436-b7e3-e5a55cb4eb3d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1749 microversion: 2.20 time: 0.148089 Oct 19 13:40:52.707735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 331/673] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:52 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1749 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:52.871100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:52.871704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:52.878579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.879056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.879482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:52.880153 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.880598 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.881011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:53.005812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:53.013519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-44b565a8-c623-4a3b-9b7c-2bc8273dc090 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.146315 Oct 19 13:40:53.014079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 343/674] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:52 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:53.732408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:53.732981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:53.739924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:53.740401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:53.740828 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:53.741504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:53.741952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:53.742399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:53.863976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:53.872332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:53.873751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:53.874909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bdd23f1e-3f8e-4513-a791-4b0095b5ef14 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1749 microversion: 2.20 time: 0.146383 Oct 19 13:40:53.875464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 332/675] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:53 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1749 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:54.037199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:54.037803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:54.044194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.044671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.045100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:54.045777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.046225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.046671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:54.177379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:54.185039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-43986834-3128-4cb4-aff5-956b24914b69 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.152301 Oct 19 13:40:54.186053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 344/676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:54 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:54.901307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:54.901933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:54.908861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.909350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.909785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:54.910475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.910966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.911479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:55.211146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:55.212266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:55.224346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:55.224346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:55.224346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:55.224346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:55.224654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:55.224654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:55.301062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:55.310234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:55.311712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:55.312862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b73c0c65-f5ee-441b-8bbf-c6aa71630bab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.415576 Oct 19 13:40:55.313411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 333/677] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:54 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:55.372036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:55.374723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:55.381547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2a9291bf-e20c-4a24-afed-b9e8d18c6819 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.176633 Oct 19 13:40:55.390705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 345/678] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:55 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:56.340424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:56.341044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:56.347701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:56.348179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:56.348608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:56.349466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:56.349924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:56.350348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:56.404853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:56.405463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:56.413360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:56.413846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:56.414412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:56.415625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:56.415625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:56.415982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:56.489998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:56.501877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:56.503763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:56.505155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8b40b1d6-83fb-4840-8689-825e0bd2a883 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.168890 Oct 19 13:40:56.505775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 334/679] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:56 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:56.564094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:56.573559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2c5c3c48-bcc6-4411-a175-930ccc091aec tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.172390 Oct 19 13:40:56.575252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 346/680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:56 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:57.529936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:57.530470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:57.532426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:57.537579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.538054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.538485 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.539187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.539641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.540063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.597047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:57.597758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:57.604366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.604925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.605418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.606186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.606739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.607220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.675556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:57.684725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:57.686385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:57.687765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-93a16fe4-1614-4a48-a6c6-b38bb77c3e83 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.161779 Oct 19 13:40:57.688282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 335/681] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:57 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:57.744352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:57.752947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e208c56f-ed08-43bd-8834-feb51130f83d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.159650 Oct 19 13:40:57.753495 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 347/682] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:57 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:40:58.713014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:58.713617 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:58.719907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.720454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.720883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.721588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.722036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.722455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.775137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:58.775763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:58.782170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.782669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.783098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.783783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.784227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.784640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.851529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:58.860447 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:58.861833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:58.863009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e487896d-7d8d-4ae3-98f7-43a5778f62e9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.153829 Oct 19 13:40:58.863566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 336/683] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:58 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:40:58.918269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:58.925796 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-16c49d1e-bc6b-43c2-b236-2425c51e3b8d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.154440 Oct 19 13:40:58.926356 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 348/684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:58 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:59.888978 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:59.889583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:59.895971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.896452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.896887 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:59.897571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.898023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.898444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:59.912784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:59.949306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:59.949937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:59.956685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.959178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.959178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:59.959178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.959178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.959532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:00.031271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:00.039987 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:00.041467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:00.042687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-842a6828-67d7-4b60-b426-9a1c412d36fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.157575 Oct 19 13:41:00.043247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 337/685] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:40:59 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:00.091550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:00.099175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-47485afd-629e-4daa-bf76-e213c93e1f5f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.153814 Oct 19 13:41:00.099742 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 349/686] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:59 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:01.069597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:01.070136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:01.077031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.077511 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.077952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.078659 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.079117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.080149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.121263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:01.121977 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:01.128945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.129498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.129995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.130788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.131306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.131890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.207179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:01.216161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:01.217604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:01.218821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7f724be7-7f50-40f5-95fc-d0ac27e9d084 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.153108 Oct 19 13:41:01.219390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 338/687] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:01 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:01.259767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:01.268291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f58f390c-1a06-43fb-a793-e652d91a3572 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.150883 Oct 19 13:41:01.268844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 350/688] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:01 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:02.243660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:02.244271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:02.250661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.251145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.251580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.252267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.252718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.253290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.291849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:02.292481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:02.298846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.299332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.299762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.300449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.300901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.301323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.379506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:02.388726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:02.390248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:02.391597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3bec2c26-4ad1-427e-ab79-074855b52a2e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.151985 Oct 19 13:41:02.392709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 339/689] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:02 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:02.432015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:02.440170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8c7e9ae2-1aa5-4ef3-8ade-29073ee073e7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.152161 Oct 19 13:41:02.440723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 351/690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:02 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:03.417263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:03.417877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:03.425034 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.425510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.425947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.426952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.427406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.427831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.462748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:03.463433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:03.470847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.471388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.471817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.472557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.473188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.473667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.561695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:03.571030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:03.572444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:03.573761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3e653e7c-b4db-45c1-ba27-d84142c34be1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.160312 Oct 19 13:41:03.574318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 340/691] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:03 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:03.609738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:03.617861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-247dc599-1c17-47fb-9929-5506738e5e1a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.158893 Oct 19 13:41:03.618431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 352/692] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:03 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:04.601045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:04.601666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:04.608092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.608576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.610970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.610970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.610970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.611269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.639943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:04.640557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:04.646929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.647412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.647841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.648572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.649025 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.649442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.742161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:04.751063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:04.752498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:04.753651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-14524592-ef7d-4fe4-917e-9ce2e5b06b63 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.156509 Oct 19 13:41:04.754195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 341/693] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:04 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:04.793713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:04.802297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bfd1cf67-f9d3-42d8-a7fa-c0f104c1c77f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.166242 Oct 19 13:41:04.802873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 353/694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:04 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:04.930594 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530fa5a-76ad-4149-99bd-909c686e1e79", "name": "network-vif-plugged", "status": "completed", "tag": "77511b14-976b-4336-8b31-a9eb1f588505"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:04.939873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.940388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.940818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.951196 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] Creating event network-vif-plugged:77511b14-976b-4336-8b31-a9eb1f588505 for instance 5530fa5a-76ad-4149-99bd-909c686e1e79 on hv-cinder-86188 Oct 19 13:41:04.956224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-9f832969-5421-4047-899e-716042409a4b req-d4ac8ba6-dd30-4ab2-a2e4-250682e3e0e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029586 Oct 19 13:41:04.956799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 342/695] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:41:05.210066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:05.210904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:05.217019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.217504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.217969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.218698 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.219146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.219617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.353102 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:05.361458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3906fa05-9509-4d97-8d2b-9992e3907c02 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1596 microversion: 2.1 time: 0.155473 Oct 19 13:41:05.362080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 354/696] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:05 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:05.779962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:05.781347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:05.787430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.787914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.788349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.789033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.789487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.789905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.824920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:05.825635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:05.832330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.832904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.833343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.834034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:05.834488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:05.834940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.925632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:05.934614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:05.937224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:05.939207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9522b346-ee6e-4172-9df2-70cb52ddf7e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.163185 Oct 19 13:41:05.940516 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 343/697] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:05 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:06.008481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:06.016140 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9eb9fab6-f7fb-49c2-8505-69e0fcdae0ef tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.195096 Oct 19 13:41:06.016724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 355/698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:05 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:06.964815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:06.965819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:06.972166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:06.974883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:06.974883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:06.974883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:06.974883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:06.975451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.042732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:07.043498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:07.050391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:07.055180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:07.055180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.055180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:07.055180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:07.056139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.107444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:07.116672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:07.118109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:07.119346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e49fd179-bb2d-4f6c-b35b-959e3ba17f41 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.158508 Oct 19 13:41:07.119900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 344/699] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:06 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:07.466889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:07.474678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-62abff4d-430f-48c3-a497-59bb5ba14025 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.435979 Oct 19 13:41:07.475490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 356/700] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:07 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:07.789540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:07.800274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:07.801507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:07.801945 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.813752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] Creating event network-changed:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:41:07.822717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-349c1af5-a54a-45ed-9263-a89afd1ad852 req-eae8dd3c-468a-4f13-b051-fb54163d26a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100996 Oct 19 13:41:07.822717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 345/701] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:41:08.145256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:08.145871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:08.152266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.152751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.153190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.153880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.154334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.154787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.286830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:08.295751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:08.297178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:08.299151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-206fffed-2db5-4a6a-8e54-6de6546dfb61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.157770 Oct 19 13:41:08.299714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 357/702] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:08 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:08.498669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:08.499545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:08.505676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.506162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.506632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.507331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.507791 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.508221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.665297 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:08.676902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6dcc4ff5-b9d3-4500-8db8-cb46ab522c97 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.182157 Oct 19 13:41:08.677353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 346/703] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:08 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:09.324626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:09.325233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:09.332466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.332942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.333371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.334051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.334498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.339561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.514747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:09.523864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:09.525338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:09.526497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-48bc299a-f527-4624-9260-c993be28d167 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.205700 Oct 19 13:41:09.527087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 358/704] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:09 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:09.698399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:09.703788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:09.705766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.706335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.706763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.707463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.707923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.708370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.839694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:09.847760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-422867c5-ed27-415b-985a-954065310231 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.153337 Oct 19 13:41:09.848332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 347/705] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:09 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:09.901069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-795761644"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:09.901611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:09.908305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.908786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.909241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.909980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.910427 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.914044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.038392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.network.security_group_api [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Adding security group 48b42a5e-20d9-42a9-a8ac-a308894b545b to port 88b37321-a984-4072-8e27-c154509a5b29 Oct 19 13:41:10.420022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-533f5bc1-4971-4705-9b66-17fb7c6b2cad tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action" status: 202 len: 0 microversion: 2.1 time: 0.522622 Oct 19 13:41:10.424385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 359/706] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:41:09 2022] POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:41:10.429167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:10.429776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:10.436584 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.437216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.437762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.438635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.439199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.439791 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.447603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:10.461865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.462553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.463143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.478636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] Creating event network-changed:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:41:10.485409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-a8f3f60e-0ebc-4e63-aff1-e1ea26330f09 req-1db6eed5-0c29-4ef5-a08d-4ea7ecc1dd51 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043567 Oct 19 13:41:10.486398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 360/707] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:41:10.552975 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:10.554230 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:10.560803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.561486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.562100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.562824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.563461 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.563886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.635007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:10.649829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c1da7d6c-eb1e-4b37-85cb-14a8373b9136 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1642 microversion: 2.1 time: 0.224836 Oct 19 13:41:10.652807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 348/708] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:10 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1642 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:10.720608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:10.729227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:10.730696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:10.731912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4efd1ac4-2432-44c4-94f6-a90b0119ab29 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.183498 Oct 19 13:41:10.732576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 361/709] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:10 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:41:10.871390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:10.872070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:10.879452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.879939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.880369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.881054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.881508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.881926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:11.022142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:11.029920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-69fb4dae-c9b5-4abc-a2aa-826a08805e0f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.162492 Oct 19 13:41:11.033318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 349/710] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:10 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:11.757345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:11.757961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:11.764471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:11.764959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:11.765395 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:11.766081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:11.767063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:11.767486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:11.898955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:11.908140 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:11.909575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:11.910751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8f82ed5a-3a12-4619-866b-b943382c089c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1751 microversion: 2.20 time: 0.157457 Oct 19 13:41:11.911306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 362/711] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:11 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:12.053416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:12.054018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:12.060700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.061177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.061609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:12.062344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.062849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.063296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:12.210564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:12.218258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a7ea6891-bb71-459a-acfc-8d959a4e7d54 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1266 microversion: 2.1 time: 0.168956 Oct 19 13:41:12.222870 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 350/712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:12 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:12.936050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:12.936786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:12.943508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.943990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.944420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:12.945107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.945557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.946030 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:12.961787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:13.082329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.090905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.092405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.093478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2e4c6113-e5f1-4482-bcfa-0fd300b74306 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.161384 Oct 19 13:41:13.094021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 363/713] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:12 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:13.241771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:13.242409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:13.248727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:13.249199 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:13.249624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:13.250296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:13.250771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:13.251185 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:13.431565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.439394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5dead8d5-4f07-4e55-b0c3-63ae15e11666 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1453 microversion: 2.1 time: 0.201497 Oct 19 13:41:13.439953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 351/714] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:13 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:13.462415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:13.463055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:13.464853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:13.470093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:13.470621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:13.471061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:13.471749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:13.472198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:13.472617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:13.602311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.610292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-12ed62f2-53f1-4635-b588-b0711d3ba7d8 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1453 microversion: 2.1 time: 0.151616 Oct 19 13:41:13.610897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 364/715] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:13 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:14.025216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:14.025722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:14.031710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.032238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.032665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.033540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.033992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.034411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.119999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:14.120603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:14.128265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.128751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.129520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.130347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.130837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.131308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.162931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'services' on Instance uuid 6be44629-963d-4b29-a35b-4d44167bc3a0 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:41:14.333074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:14.341976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:14.343612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:14.344619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-30f7bc0a-322a-46b4-9fcc-a5f08521043f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.228715 Oct 19 13:41:14.345214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 365/716] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:14 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:14.399039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c2b0acc1-e7ea-4abd-8207-7251da5f5158 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0/os-volume_attachments/0cb8c0ad-1df9-44c5-8b73-6949fc8a1a08" status: 202 len: 0 microversion: 2.1 time: 0.378105 Oct 19 13:41:14.399988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 352/717] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:41:14 2022] DELETE /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0/os-volume_attachments/0cb8c0ad-1df9-44c5-8b73-6949fc8a1a08 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:41:15.371321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:15.372554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:15.379835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:15.380546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:15.380971 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:15.381844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:15.382291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:15.383053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:15.844240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:15.852818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:15.857066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:15.857066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8088bf2b-b761-4f28-b2eb-f144f5e73c3f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.488031 Oct 19 13:41:15.857066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 366/718] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:15 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:16.115283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5530fa5a-76ad-4149-99bd-909c686e1e79", "tag": "77511b14-976b-4336-8b31-a9eb1f588505"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:16.129303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:16.129649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:16.130321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:16.142630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] Creating event network-changed:77511b14-976b-4336-8b31-a9eb1f588505 for instance 5530fa5a-76ad-4149-99bd-909c686e1e79 on hv-cinder-86188 Oct 19 13:41:16.147926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-3d88eab8-0f65-4947-9938-51bf0412aa4a req-d061cc6a-e290-4dce-8d87-20b52632a575 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037686 Oct 19 13:41:16.149148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 353/719] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:41:16.882124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:16.882824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:16.889423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:16.889903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:16.890327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:16.891053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:16.891602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:16.892203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:17.048090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:17.058033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:17.059968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:17.061247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5192ce5d-83d2-48bb-a8bc-3f21a3932dd7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.183578 Oct 19 13:41:17.062210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 367/720] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:16 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:18.089006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:18.090339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:18.097336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:18.097812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:18.098245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:18.098968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:18.099416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:18.099833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:18.239879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:18.248373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:18.249858 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:18.251004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-567b5c2e-ba1b-4ba0-b6e3-f0fc67133a60 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.167798 Oct 19 13:41:18.252188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 354/721] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:18 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:19.277504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:19.278100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:19.284782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:19.285263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:19.285723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:19.286416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:19.286891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:19.287312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:19.426807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:19.435694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:19.437118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:19.438375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cb844d72-0b1f-4976-beb8-fc01d3892457 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.165782 Oct 19 13:41:19.450531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 368/722] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:19 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:20.465161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:20.465768 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:20.472732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:20.473209 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:20.473646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:20.474326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:20.474802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:20.475225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:20.490881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:20.607346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:20.617042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:20.618461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:20.619635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f7f25f83-4e28-4515-b40f-7bf58ad1e4e2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.158367 Oct 19 13:41:20.620231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 355/723] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:20 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:21.646211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:21.646844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:21.653738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:21.654233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:21.654674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:21.655361 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:21.655812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:21.656230 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:21.790618 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:21.799311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:21.801067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:21.802211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cfac2136-30b4-4536-8f9a-58240774763f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.161019 Oct 19 13:41:21.802797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 369/724] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:21 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:22.828959 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:22.829550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:22.831852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=52 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:22.836524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:22.837103 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:22.837710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:22.838612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:22.839079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:22.839724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:22.981488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:22.990842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:22.992291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:22.993450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3c021494-2787-4484-b0a2-ec6a05501135 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.168426 Oct 19 13:41:22.994996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 356/725] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:22 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:24.023838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:24.024528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:24.031492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:24.032079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:24.032915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:24.033860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:24.034383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:24.034921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:24.171324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:24.181242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:24.182723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:24.183892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b38e391a-5e67-4589-8a15-f9a751352d6e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.164707 Oct 19 13:41:24.184844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 370/726] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:24 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:25.209588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:25.210171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:25.216866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:25.217352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:25.217802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:25.218483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:25.218979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:25.219405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:25.354444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:25.364543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:25.365956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:25.367150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-24d39bd5-f2f8-4610-906a-19eec830d898 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.161545 Oct 19 13:41:25.367704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 357/727] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:25 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:26.393501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:26.394059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:26.400631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:26.401103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:26.401535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:26.402234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:26.402724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:26.403141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:26.527192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:26.536694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:26.538150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:26.539322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8246b356-bbb0-4de1-9af7-c3bb7e25b7be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.150398 Oct 19 13:41:26.540016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 371/728] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:26 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:27.565692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:27.566293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:27.572666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:27.573139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:27.573565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:27.574238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:27.574728 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:27.575150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:27.697281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:27.705716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:27.707164 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:27.708295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0086e513-e74f-4600-93b9-b737d1b17231 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.147074 Oct 19 13:41:27.708840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 358/729] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:27 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:28.733405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:28.734013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:28.740418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:28.740897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:28.741330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:28.742011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:28.742466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:28.742912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:28.868122 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:28.877186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:28.878644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:28.879794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a9c0d66e-c40b-42ba-9bbb-beb3f4617396 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.150251 Oct 19 13:41:28.880377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 372/730] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:28 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:29.905449 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:29.906354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:29.912616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:29.913125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:29.913565 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:29.914251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:29.914731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:29.915156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:30.052966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:30.061365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:30.062829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:30.065634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d3c24187-daec-4b67-a5b8-32180dece904 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.162571 Oct 19 13:41:30.065634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 359/731] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:29 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:31.090196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:31.090846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:31.097275 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:31.097755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:31.098190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:31.098897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:31.099349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:31.099768 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:31.226870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:31.235330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:31.237279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:31.238419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d0f7fbf4-b424-45fa-8ccf-2e55a1a86b66 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.152106 Oct 19 13:41:31.239009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 373/732] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:31 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:32.264189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:32.264709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:32.271687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.272232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.272854 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.273532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.273976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.274391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.405417 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:32.413884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:32.415332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:32.416500 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3942c482-d204-4861-8f21-f6cbcb9dc27a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.156191 Oct 19 13:41:32.417050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 360/733] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:32 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:32.495694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:32.496174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:32.503258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.503729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.504152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.504821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.505267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.505681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.530271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:41:32.781850 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-894b3573-7c22-4afe-850d-83e7d89788ac tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 204 len: 0 microversion: 2.1 time: 0.289506 Oct 19 13:41:32.782384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 374/734] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:41:32 2022] DELETE /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:41:32.790425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:32.792415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:32.799852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.800614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.801050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.801743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.802195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.802668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.932107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:32.940299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a3a3946a-96e3-471a-8f52-a50d4eb38246 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1513 microversion: 2.1 time: 0.153606 Oct 19 13:41:32.940875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 361/735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:32 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:41:33.442284 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:33.442998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:33.448921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.449399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.449831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:33.450534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.450980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.451399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:33.577894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:33.587110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:33.588559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:33.589709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ad70a0e2-2133-4afc-b4e3-5c6edfeb1867 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.151723 Oct 19 13:41:33.590261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 375/736] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:33 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:33.962714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:33.963323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:33.969595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.970073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.970524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:33.971205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.971662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.972082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:34.095509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:34.103024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-afc7922f-3594-496f-a9dd-a83484520ec2 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1513 microversion: 2.1 time: 0.144188 Oct 19 13:41:34.103589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 362/737] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:33 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:34.616454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:34.617058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:34.623407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:34.623878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:34.624303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:34.624980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:34.625424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:34.625842 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:34.755541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:34.763891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:34.765308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:34.766471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8bec63be-1e92-41c3-9a7c-701707314251 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.153883 Oct 19 13:41:34.767015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 376/738] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:34 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:35.126235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:35.126924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:35.133260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.133735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.134163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.134867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.135311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.135725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.260105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:35.268178 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f8eceaac-6854-4da7-b786-25603e15d796 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1513 microversion: 2.1 time: 0.145887 Oct 19 13:41:35.268733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 363/739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:35 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:35.792149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:35.792783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:35.799893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.800635 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.801059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.801799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.802245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.802692 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.909150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be44629-963d-4b29-a35b-4d44167bc3a0", "name": "network-vif-deleted", "tag": "b4081753-ab74-478c-8676-6cd09a91aa21"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:35.919193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.919613 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.921085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.931161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] Creating event network-vif-deleted:b4081753-ab74-478c-8676-6cd09a91aa21 for instance 6be44629-963d-4b29-a35b-4d44167bc3a0 on hv-cinder-86188 Oct 19 13:41:35.935917 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:35.936261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-8452ab61-3d87-4c96-9345-62189a57100d req-563c4f9c-9eff-40a5-973c-4020fc796920 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031588 Oct 19 13:41:35.937264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 364/740] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:41:35.945028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:35.946467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:35.947703 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-121ef179-9aad-477a-89cf-995b1ca24a4c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.159455 Oct 19 13:41:35.949723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 377/741] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:35 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:36.292549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:36.293241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:36.299436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.299913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.300602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.301280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.301726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.302153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.334340 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.334835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.335267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.335702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'fault' on Instance uuid 6be44629-963d-4b29-a35b-4d44167bc3a0 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:41:36.374800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:36.382919 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b734b435-96c9-476b-a7fe-7a738faa257c tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1309 microversion: 2.1 time: 0.095062 Oct 19 13:41:36.383410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 365/742] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:36 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:36.973636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:36.974274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:36.980701 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.981181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.981617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.982297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.982772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.983197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.998176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:37.113883 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:37.122228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:37.123684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:37.124828 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dcc5ebd6-4516-481e-b5e0-a74f182df4bc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.155594 Oct 19 13:41:37.125370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 378/743] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:36 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:37.405773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:37.406378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:37.413629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:37.414102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:37.414556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:37.415237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:37.415689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:37.416111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:37.596062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:37.596546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:37.596972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:37.597408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'fault' on Instance uuid 6be44629-963d-4b29-a35b-4d44167bc3a0 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:41:37.638807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:37.646879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-858f613e-0a4e-4a27-8414-393c59fe85fd tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1309 microversion: 2.1 time: 0.244938 Oct 19 13:41:37.647434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 366/744] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:37 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:38.149160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:38.149776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:38.156485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.156970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.157405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.158094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.158573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.158999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.285513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:38.294036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:38.295490 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:38.296627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cc3e44b2-a476-4fbf-95cf-92653ce5b019 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.151375 Oct 19 13:41:38.297167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 379/745] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:38 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:38.669123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:38.669727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:38.677026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.677501 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.677928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.678625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.679074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.679491 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.710057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.710537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.710971 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.711404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lazy-loading 'fault' on Instance uuid 6be44629-963d-4b29-a35b-4d44167bc3a0 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:41:38.751415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7a8349031b4f87a4f477e4a4e6ba2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20b3147c0d14452b9c5f22801c89990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:38.758977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-664ab8c2-c26b-4887-b21c-dfc10f1f7443 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 200 len: 1309 microversion: 2.1 time: 0.093647 Oct 19 13:41:38.759703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 367/746] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:38 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:39.323044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:39.323656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:39.330732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.331211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.331648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.332328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.332777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.333212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.462605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:39.471079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:39.472498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:39.473634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f897cace-3d2a-46b7-adef-0d951b503e0e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.154593 Oct 19 13:41:39.474198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 380/747] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:39 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:39.781309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:39.782002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] [instance: 6be44629-963d-4b29-a35b-4d44167bc3a0] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:39.788581 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.789118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.790005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.790326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.790814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.791231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.805600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] HTTP exception thrown: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Request method failure captured: Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 HTTP/1.1 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_2D-WPOl2HMsqDGBz2cPJfdcrdFrvfa400eFZOXXQmOjPVM-QeKMLbq7bqC18dqS-PoNK1pZKb1BI7Bt-Q0__BpT-ZqXvSdDNa1p1yZfwMhLkU-L52LszrtTjmcQWaI1sF7yF3uxGKraBQI1a7Jthzt-q0D4-v7h-lrSHUjGVL0p0M Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: c20b3147c0d14452b9c5f22801c89990 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:41:39.807307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c20b3147c0d14452b9c5f22801c89990", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c20b3147c0d14452b9c5f22801c89990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: c20b3147c0d14452b9c5f22801c89990 Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1256992264 Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesSnapshotTestJSON-1256992264-project Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: eb7a8349031b4f87a4f477e4a4e6ba2b Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesSnapshotTestJSON-1256992264-project Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. Oct 19 13:41:39.808752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '6be44629-963d-4b29-a35b-4d44167bc3a0'} Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:41:39.810193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. Oct 19 13:41:39.811663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:41:39.813703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] Returning 404 to user: Instance 6be44629-963d-4b29-a35b-4d44167bc3a0 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:41:39.813703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9457806e-e3a2-4b50-85f9-7d6e907ce6e9 tempest-VolumesSnapshotTestJSON-1256992264 tempest-VolumesSnapshotTestJSON-1256992264-project] 10.222.0.39 "GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0" status: 404 len: 111 microversion: 2.1 time: 0.031401 Oct 19 13:41:39.813703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 368/748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:39 2022] GET /compute/v2.1/servers/6be44629-963d-4b29-a35b-4d44167bc3a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:41:40.499257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:40.499912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:40.507108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:40.507587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:40.508021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:40.508701 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:40.509151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:40.509571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:40.650163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:40.659643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:40.661047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:40.662229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-17fc03e6-c02d-496e-83e0-07296f83458d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.166895 Oct 19 13:41:40.662822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 381/749] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:40 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:41.688259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:41.688779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:41.695907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:41.696496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:41.696958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:41.697634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:41.698110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:41.698545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:41.824861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:41.833419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:41.834902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:41.836054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1b74af6e-753a-4981-8254-48b3eede209e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.151758 Oct 19 13:41:41.836630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 369/750] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:41 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:42.325505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "name": "network-vif-plugged", "status": "completed", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:42.335451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:42.335919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:42.336338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:42.347568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] Creating event network-vif-plugged:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:41:42.352655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-99471fe1-8b77-4316-8ff4-5a4e55f8ce28 req-03861ef2-2d74-49d1-a9b1-5ab3bb177cbc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030781 Oct 19 13:41:42.353208 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 382/751] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:41:42.861223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:42.861763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:42.868174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:42.868652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:42.869084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:42.869771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:42.870206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:42.870659 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:43.005241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:43.014044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:43.015536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:43.016684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4745776b-fb5a-49eb-8e45-3f738a1053a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.159483 Oct 19 13:41:43.017850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 370/752] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:42 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:44.044366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:44.045064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:44.047084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:44.052259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:44.052726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:44.053159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:44.053843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:44.054298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:44.054751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:44.182858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:44.191593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:44.193037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:44.194195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dca2e37b-348e-4e4e-8153-0d2817d634a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.154714 Oct 19 13:41:44.194776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 383/753] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:44 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:45.221101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:45.221577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:45.228085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.228563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.229037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.229716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.230160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.230597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.322414 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158feb39-82eb-461a-959a-e041b99b876d"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:41:45.324890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:45.331005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.331491 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.331918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.332607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.333057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.333477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.363408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:45.372510 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:45.374041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:45.375327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5f2354b3-a896-4e00-b91b-143da31fe8fe tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.159170 Oct 19 13:41:45.375889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 384/754] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:45 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:41:46.402818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:46.403447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:46.410378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:46.410883 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:46.411315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:46.411990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:46.412436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:46.412849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:46.539064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:46.547448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:46.548869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:46.550255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f9caacda-2045-44d3-b35c-1daa6f238e09 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.151158 Oct 19 13:41:46.550834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 385/755] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:46 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:41:47.576161 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:47.576769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:47.583192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:47.583668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:47.584099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:47.584807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:47.585258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:47.585678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:47.710788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:47.719235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:47.721341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:47.722475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7271ca23-445c-4ff6-83ce-d8b3dcc513e1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.150251 Oct 19 13:41:47.723055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 386/756] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:47 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:41:48.747658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:48.748306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:48.755317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:48.755827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:48.756260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:48.756940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:48.757388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:48.757808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:48.888880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:48.897737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:48.899249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:48.900403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0e3ac2eb-6dc7-41d2-a929-d1c0154a7755 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.156648 Oct 19 13:41:48.900959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 387/757] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:48 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:41:48.981999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:49.511411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ac5f7e5f-8ffe-4501-ade0-b07117b98d5b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.296959 Oct 19 13:41:49.512117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 371/758] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:41:45 2022] POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments => generated 194 bytes in 4299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:41:49.938631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:49.939241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:49.945999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:49.946479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:49.946944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:49.947626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:49.948073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:49.948494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:50.078192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:50.087630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:50.089070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:50.090230 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5475e665-ce61-47e6-8d0d-d3ab02793bd3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.155531 Oct 19 13:41:50.090813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 388/759] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:49 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:51.117113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:51.117724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:51.126162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:51.126697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:51.131772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:51.131772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:51.131772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:51.131772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:51.258931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:51.267834 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:51.269256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:51.270411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1295c911-4246-41a3-b6ed-f871fded7141 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1807 microversion: 2.20 time: 0.158705 Oct 19 13:41:51.271233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 372/760] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:51 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:41:52.296322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:52.296961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:52.303193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:52.303682 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:52.304120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:52.304863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:52.305334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:52.305747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:52.441212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:52.451990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:52.453459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:52.454932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6d50f32d-5c8c-4c8c-baa3-3a8fdf663ee1 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1794 microversion: 2.20 time: 0.162656 Oct 19 13:41:52.456116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 389/761] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:41:52 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:42:03.397566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:42:03.399886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:03.402459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=39 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:03.403152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:03.407805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.408293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.408735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.409925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.410382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.410835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.434256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'flavor' on Instance uuid 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:42:03.750790 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1d9e15c3-58d9-4675-ad18-793a3f46ee3c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/action" status: 200 len: 32 microversion: 2.1 time: 0.357116 Oct 19 13:42:03.751397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 373/762] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:42:03 2022] POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:42:03.761056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:03.767079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:03.767079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=13 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:03.767079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=65 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:03.770046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.770550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.770991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.771674 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.772122 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.772539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.901986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:03.910131 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0a707119-86b2-4d00-8718-a5c6c84997eb tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.152992 Oct 19 13:42:03.911045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 390/763] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:03 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:04.934266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:04.935012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:04.941329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:04.941811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:04.942244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:04.942956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:04.943406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:04.943928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:05.070934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:05.079139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-baf8835e-1230-43e0-9d06-339343deb98c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.149555 Oct 19 13:42:05.079692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 374/764] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:04 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:06.103710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:06.104313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:06.110729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:06.111213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:06.111643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:06.112879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:06.113330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:06.113746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:06.240805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:06.248986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c6c6f77f-bc13-46a8-ab15-bcd70d0fbbbc tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.149085 Oct 19 13:42:06.254668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 391/765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:06 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:07.272258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:07.272794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:07.279150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:07.279625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:07.280257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:07.280934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:07.281384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:07.281804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:07.411213 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:07.419492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f1df0913-3e6d-4e2a-98c2-b8fb6c1884ef tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.151320 Oct 19 13:42:07.420036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 375/766] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:07 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:08.444308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:08.444868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:08.451245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:08.451749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:08.452167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:08.452913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:08.453304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:08.453725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:08.578279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:08.586978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-947db7d9-9af1-4539-a54f-33fb490347ab tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.147171 Oct 19 13:42:08.587541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 392/767] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:08 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:09.610073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:09.610740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:09.617291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:09.617721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:09.618183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:09.618916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:09.619373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:09.619806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:09.745693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:09.753792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7c6e4d8c-8421-494d-ba69-3137435b36fa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.147526 Oct 19 13:42:09.754874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 376/768] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:09 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:10.778351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:10.778992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:10.785403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:10.785886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:10.786318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:10.787591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:10.788023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:10.788446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:10.912895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:10.921484 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f6d7634a-2812-47c3-bd2a-0537e64537c0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.146966 Oct 19 13:42:10.922035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 393/769] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:10 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:11.945098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:11.945829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:11.952331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:11.952846 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:11.953282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:11.953968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:11.954420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:11.954874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:12.083140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:12.091821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0c983e3d-86c9-4750-9eb0-b352d20f07ac tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.150655 Oct 19 13:42:12.092380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 377/770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:11 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:13.115531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:13.116688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:13.122991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:13.123476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:13.123912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:13.124597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:13.125047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:13.125468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:13.280944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:13.289775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bd75cd8d-f8e0-4997-a930-d9c44e48851b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.178626 Oct 19 13:42:13.290326 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 394/771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:13 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:14.313117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:14.313727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:14.320893 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:14.321375 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:14.321888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:14.322603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:14.323055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:14.323479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:14.452404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:14.461139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7dd8b07f-22d0-44e1-aeba-b5d6c081fad4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.151873 Oct 19 13:42:14.461695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 378/772] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:14 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:15.483483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:15.484144 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:15.490631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:15.491108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:15.491566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:15.492248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:15.492694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:15.493107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:15.619258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:15.627335 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-22428a64-0648-4bdf-b6a6-1c0fac4a7de1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.147657 Oct 19 13:42:15.627896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 395/773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:15 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:16.650938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:16.651575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:16.658024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:16.658494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:16.658962 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:16.659635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:16.660084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:16.660502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:16.788355 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:16.796468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2525fb32-c552-4c84-a532-60ca6c1411c9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.149582 Oct 19 13:42:16.797027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 379/774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:16 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:17.821151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:17.821762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:17.828304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:17.828795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:17.829232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:17.829926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:17.830379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:17.830837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:17.961677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:17.969748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0609d1e1-cca6-49b2-82d6-405f5875bd0a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.153170 Oct 19 13:42:17.970299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 396/775] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:17 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:18.993438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:18.994047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:19.000820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:19.001315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:19.001750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:19.002436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:19.002914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:19.003364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:19.127235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:19.136022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e3c899f3-3451-403d-9626-81d38113bab0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.146498 Oct 19 13:42:19.136573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 380/776] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:18 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:20.159021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:20.159625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:20.166721 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:20.167195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:20.167622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:20.168297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:20.168743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:20.169161 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:20.295083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:20.303422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-67bf9223-9286-4374-a4c7-ae4ef5a4cdaa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.148218 Oct 19 13:42:20.308816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 397/777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:20 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:21.326562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:21.327179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:21.333586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:21.334066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:21.334529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:21.335704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:21.336157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:21.336580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:21.465394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:21.473536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c31fb009-979e-42a3-bd97-b985b58c717e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.150961 Oct 19 13:42:21.474094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 381/778] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:21 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:22.497162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:22.497764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:22.503822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:22.504295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:22.504724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:22.505427 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:22.505873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:22.506291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:22.636864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:22.644999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6843b078-1ca1-4a24-b992-e2784d71e9cf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.151686 Oct 19 13:42:22.645572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 398/779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:22 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:23.668640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:23.669100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:23.676316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:23.676897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:23.677319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:23.677998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:23.678973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:23.679394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:23.806466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:23.814675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b09536c7-a432-4465-aef4-a7ccaaba47da tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.150042 Oct 19 13:42:23.815236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 382/780] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:23 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:24.838966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:24.839569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:24.845909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:24.846388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:24.846862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:24.847538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:24.847984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:24.848406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:24.973272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:24.981439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-09420ac6-4a8d-41c5-b46b-741801a42d52 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.146944 Oct 19 13:42:24.981994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 399/781] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:24 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:26.004857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:26.005806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:26.011981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:26.012458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:26.012888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:26.013572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:26.014019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:26.014440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:26.155559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:26.155559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a0c6f670-cb3f-4a39-9851-3da41a7c4c0b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.151162 Oct 19 13:42:26.155559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 383/782] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:25 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:27.177249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:27.177884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:27.185084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:27.187573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:27.187573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:27.187573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:27.187573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:27.187962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:27.312547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:27.320678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c7b3fad2-359d-4152-8ac7-f4fa993db478 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.147510 Oct 19 13:42:27.321233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 400/783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:27 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:28.342757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:28.343373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:28.349727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:28.350249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:28.350715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:28.351404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:28.351861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:28.352286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:28.479666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:28.487845 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-67e6c3d7-06c8-4993-a369-260aab0024bf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.148966 Oct 19 13:42:28.488406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 384/784] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:28 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:29.512328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:29.512840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:29.519285 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:29.519759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:29.520192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:29.520872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:29.521320 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:29.521736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:29.650192 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:29.658428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4a71bd96-6558-4bc0-ade6-51bf3518dd88 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.150576 Oct 19 13:42:29.659011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 401/785] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:29 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:30.681444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:30.682697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:30.689262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:30.689743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:30.690170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:30.690900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:30.691349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:30.691767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:30.819049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:30.827684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-56e7a315-5ea4-4596-8196-b3e91c78eee1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.150370 Oct 19 13:42:30.828238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 385/786] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:30 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:31.850303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:31.850935 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:31.857885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:31.858400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:31.858859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:31.859531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:31.859981 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:31.860399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:31.984502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:31.992587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-35fbfca6-fa65-4459-be9b-82fdf8576ad7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.146107 Oct 19 13:42:31.993148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 402/787] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:31 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:33.015989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:33.016598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:33.023113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:33.023624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:33.024063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:33.024758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:33.025217 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:33.025644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:33.148849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:33.157049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e4d567ff-b3f9-40c5-ba37-a6fad91b9c95 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.144923 Oct 19 13:42:33.157606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 386/788] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:33 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:34.180949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:34.181564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:34.183906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=27 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:34.190148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:34.190148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:34.190148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:34.190148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:34.191083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:34.191196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:34.195035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=79 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:34.321830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:34.330154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-853ca50a-f25c-464c-8482-e1bac0d12868 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.153500 Oct 19 13:42:34.333554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 403/789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:34 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:35.353141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:35.353775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:35.356210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=29 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:35.360855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:35.361338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:35.361773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:35.362456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:35.362940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:35.363365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:35.365858 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:35.491979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:35.500659 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-424bc7bc-bc59-43fa-b3be-4f9980bbb65b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.151347 Oct 19 13:42:35.501222 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 387/790] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:35 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:36.523938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:36.524551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:36.531431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:36.531909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:36.532343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:36.533025 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:36.533478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:36.533897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:36.657941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:36.666255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3941d8ed-ab7e-4658-84fc-84f1c08a628b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1733 microversion: 2.1 time: 0.146018 Oct 19 13:42:36.666841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 404/791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:36 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:37.689780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:37.690326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:37.696840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:37.697320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:37.697813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:37.698522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:37.698981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:37.699406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:37.824738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:37.832808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1bd9844e-56b7-4111-b3bc-f89eedd05cf0 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1713 microversion: 2.1 time: 0.146982 Oct 19 13:42:37.833366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 388/792] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:37 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1713 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:38.012476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:38.012476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:38.012476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.012476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.013116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.013116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.013116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.013116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.042617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] HTTP exception thrown: Cannot 'detach_volume' instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 while it is in vm_state rescued Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Request method failure captured: Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments/158feb39-82eb-461a-959a-e041b99b876d HTTP/1.1 Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z97DcIsQ_Yj_t4gqBEsR_6QQ5NQGSvnfsgsIEqGGOwz-DvZRcPl-dL3hmg4HvhX1KuS3sK5aMUlDU0_ucx7mh4jVyXq71WamPFZfjfieG1gx_fRs4LuobUsUPdtmqs0btq5sTPb6OcZF-OKmGq51PcAhwFzMghs9YDmdYduQbqOwA Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:42:38.044257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3e2936fe3344e60b6f3dc918b9c738e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 020ff888a8a44d2eb6961829407637a9 Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:42:38.045877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Cannot 'detach_volume' instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 while it is in vm_state rescued Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'server_id': '1a369c01-b0ab-4e73-a911-ecd5f4ceb271', 'id': '158feb39-82eb-461a-959a-e041b99b876d'} Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:42:38.046795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 while it is in vm_state rescued Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 while it is in vm_state rescued Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:42:38.048595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Returning 409 to user: Cannot 'detach_volume' instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 while it is in vm_state rescued {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:42:38.050101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-15b275ef-5858-4e30-a8c5-2d89538ac988 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments/158feb39-82eb-461a-959a-e041b99b876d" status: 409 len: 152 microversion: 2.1 time: 0.106332 Oct 19 13:42:38.050101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 405/793] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:42:37 2022] DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments/158feb39-82eb-461a-959a-e041b99b876d => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 13:42:38.054806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:42:38.055339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:38.061123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.061606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.062038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.062744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.063197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.063618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.296827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b0c5935e-2f55-48b5-945d-4b3866923178 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/action" status: 202 len: 0 microversion: 2.1 time: 0.245622 Oct 19 13:42:38.297579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 389/794] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:42:38 2022] POST /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:42:38.305915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:38.306538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:38.313384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.313870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.314306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.315026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.315477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.315904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.445551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:38.454141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5e9f679a-7b7f-43ee-bb27-63504e1a7ab8 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1721 microversion: 2.1 time: 0.152123 Oct 19 13:42:38.454738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 406/795] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:38 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:42:39.479650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:39.480396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:39.486994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:39.487479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:39.487918 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:39.488606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:39.489065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:39.489492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:39.616529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:39.624646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-744220e2-b926-417f-8b73-c9fb18cc19ae tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1721 microversion: 2.1 time: 0.149867 Oct 19 13:42:39.625205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 390/796] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:39 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:40.648290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:40.648882 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:40.655351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:40.655838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:40.656272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:40.656954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:40.657405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:40.657825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:40.783387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:40.792245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-74b1987a-9e70-43b2-936b-ffa7538190fd tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1721 microversion: 2.1 time: 0.147812 Oct 19 13:42:40.792807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 407/797] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:40 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:41.815735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:41.816274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:41.822729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:41.823768 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:41.824201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:41.824878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:41.825326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:41.825742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:41.953015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:41.961019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-28627406-98f0-4592-936e-37fd9b5274de tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1721 microversion: 2.1 time: 0.149235 Oct 19 13:42:41.961570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 391/798] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:41 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:42.985797 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:42.987136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:42.994233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.001006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.001006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.001006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.001006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.001845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.135107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:43.141228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-590cb741-4db3-4bbd-9423-cdfd73f4989f tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1727 microversion: 2.1 time: 0.160824 Oct 19 13:42:43.141890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 408/799] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:42 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:43.164649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:43.165157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:43.171109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.171593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.172058 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.172746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.173457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.173951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.250303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cc573268-9403-439d-ac17-ff8ade2afc93 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089401 Oct 19 13:42:43.251123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 392/800] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:42:43 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:42:44.164714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:42:44.179514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:44.181739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:44.182436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:44.202117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] Creating event network-changed:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:42:44.207693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-e2949021-b34c-47c7-acec-9b2985f25ab6 req-9a439c4f-a800-4717-8920-19b1c64ca903 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048441 Oct 19 13:42:44.208560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 409/801] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:42:46.223606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:42:46.233578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:46.234052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:46.234530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:46.245359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] Creating event network-changed:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:42:46.250321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-a9f0bdc6-99dd-421a-a2d4-b631f7d9d50a req-c8a6832e-a8cf-4301-8d1e-c1b6c1d553ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030944 Oct 19 13:42:46.251616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 393/802] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:43:19.894274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:43:19.896579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:19.898895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=13 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:19.899660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=37 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:19.900581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:19.900725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Wed Oct 19 13:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action (ip 10.222.0.39) !!! Oct 19 13:43:19.902555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:19.902669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Wed Oct 19 13:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action (ip 10.222.0.39) !!! Oct 19 13:43:19.911884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:19.912362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:19.912794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:19.913473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:19.913920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:19.914337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:20.113163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-20d4d8c4-692d-4b01-91d7-f1d07ad5a630 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action" status: 202 len: 0 microversion: 2.1 time: 0.222924 Oct 19 13:43:20.114001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 410/803] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:43:19 2022] POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:43:20.119768 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=13 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:20.120505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:20.121256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:20.121386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Wed Oct 19 13:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 (ip 10.222.0.39) !!! Oct 19 13:43:20.127270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:20.128006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:20.135289 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:20.135771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:20.136205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:20.136896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:20.137348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:20.137773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:20.283459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:20.291736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7c4ca8ae-89d7-4432-9dd3-3971acf4983c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1753 microversion: 2.1 time: 0.173630 Oct 19 13:43:20.292304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 394/804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:20 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:21.316306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:21.317004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:21.323181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:21.323663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:21.324104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:21.324786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:21.325245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:21.325663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:21.464556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:21.473155 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2c0f8bc5-bb4b-4bbf-8f21-5581b6ff8ade tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.161625 Oct 19 13:43:21.473717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 411/805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:21 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:22.496922 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:22.497528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:22.504189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:22.504663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:22.505121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:22.505795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:22.506245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:22.506695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:22.644949 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:22.653281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e1747fee-6794-4d13-9554-9b7af8ed454c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.160562 Oct 19 13:43:22.653831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 395/806] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:22 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:23.676063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:23.676704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:23.683421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:23.683907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:23.684340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:23.685119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:23.685672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:23.686097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:23.823561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:23.832152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f367e9ea-a471-40ca-922c-b43682ffc11e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.160242 Oct 19 13:43:23.832722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 412/807] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:23 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:24.855362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:24.855974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:24.862938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:24.863423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:24.863864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:24.864543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:24.864994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:24.865416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:25.002809 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:25.011072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ccaa16a6-a172-4ea9-9672-959a041bf042 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.159531 Oct 19 13:43:25.011638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 396/808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:24 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:26.034004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:26.034644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:26.041106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:26.041796 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:26.042002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:26.042723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:26.043200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:26.043667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:26.179390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:26.187509 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6cc178f7-e953-4116-b4d9-4c19ee56ae6d tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.157549 Oct 19 13:43:26.188069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 413/809] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:26 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:27.210785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:27.211450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:27.218300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:27.218811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:27.219247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:27.219933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:27.220379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:27.220796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:27.362685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:27.370797 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-19f0f837-f69f-4982-9604-3453d33ccbfc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.163935 Oct 19 13:43:27.371362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 397/810] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:27 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:28.394031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:28.394691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:28.401130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:28.401667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:28.402083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:28.402785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:28.403795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:28.404211 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:28.542791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:28.551491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-798e7fd3-bf2a-4cbc-aacb-d1fd8b2183f0 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.161402 Oct 19 13:43:28.552054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 414/811] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:28 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:29.574558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:29.575180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:29.581550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:29.582031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:29.582497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:29.583203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:29.583654 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:29.584079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:29.724400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:29.733308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-07f49fda-03b7-4af4-9751-be2d53618ae9 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.162687 Oct 19 13:43:29.733865 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 398/812] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:29 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:30.756389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:30.756998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:30.763566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:30.764042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:30.764473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:30.765156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:30.765607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:30.766028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:30.901534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:30.910154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ff685906-d48c-423d-b1f4-0ceea50b2c14 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1758 microversion: 2.1 time: 0.157648 Oct 19 13:43:30.910757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 415/813] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:30 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:43:31.933722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:31.935022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:31.941440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:31.941916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:31.942374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:31.943075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:31.943525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:31.943946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:32.086573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:32.095341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-618d7b13-cd38-4266-8e28-c2785373faaa tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1761 microversion: 2.1 time: 0.165558 Oct 19 13:43:32.095912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 399/814] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:31 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:37.208129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:37.208660 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:37.215145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.215622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.216051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.217341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.217792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.218213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.245955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-75b4e4ea-b091-49ba-9767-e5018e99cb27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments/31468061-774e-4ae8-936e-72cb412b3418" status: 200 len: 194 microversion: 2.20 time: 0.041821 Oct 19 13:43:37.246519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 416/815] 10.222.0.39 () {60 vars in 1454 bytes} [Wed Oct 19 13:43:37 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments/31468061-774e-4ae8-936e-72cb412b3418 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:43:37.312678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:37.313186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:37.319523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.320000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.320433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.321110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.321561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.321977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.400050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lazy-loading 'services' on Instance uuid d15930e1-efde-41f3-a7b7-0da49230281e {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:43:37.633028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-92c69485-100b-44dd-b7c2-f437c4d5591b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments/31468061-774e-4ae8-936e-72cb412b3418" status: 202 len: 0 microversion: 2.20 time: 0.324136 Oct 19 13:43:37.633794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 400/816] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Oct 19 13:43:37 2022] DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments/31468061-774e-4ae8-936e-72cb412b3418 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:43:37.643516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:37.645681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:37.651816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.652293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.652718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.653397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.653840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.654351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.683961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ea739dac-53cb-4989-99cb-65b05d2c0241 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045194 Oct 19 13:43:37.684502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 417/817] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 13:43:37 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:43:38.697922 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:38.700295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:38.707543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:38.708061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:38.708497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:38.709204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:38.709658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:38.710082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:38.738952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-040a11a2-a9ba-493d-bcd2-3c55eb352045 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045467 Oct 19 13:43:38.739505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 401/818] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 13:43:38 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:43:39.751596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:39.753698 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:39.760086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.760559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.760990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.761689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.762137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.762575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.792034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-556399cc-c30f-448a-a079-95d5a728ebb4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044394 Oct 19 13:43:39.792578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 418/819] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 13:43:39 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:39.855807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:39.856293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:39.862643 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.863124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.863559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.864235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.864689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.865108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.891082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:43:40.188261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-05f52e85-97dd-4f99-9765-028441833be6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 204 len: 0 microversion: 2.20 time: 0.335969 Oct 19 13:43:40.188890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 402/820] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 13:43:39 2022] DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 13:43:40.197055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:40.197662 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:40.203483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:40.203954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:40.204379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:40.205051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:40.205496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:40.205913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:40.334087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:40.342052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:40.343505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:40.344640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-92fee1a1-2a4f-4733-b615-02324d37abce tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.151448 Oct 19 13:43:40.345183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 419/821] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:40 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:41.370983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:41.371689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:41.378568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:41.379051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:41.379488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:41.380175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:41.380631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:41.381055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:41.506281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:41.515091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:41.519461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:41.519461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d94c81ae-4efa-423d-a8f9-ced33e9f3bd5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.151065 Oct 19 13:43:41.519461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 403/822] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:41 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:42.543540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:42.544149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:42.551123 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:42.551608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:42.552041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:42.552729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:42.553176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:42.553593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:42.680962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:42.689144 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:42.690634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:42.691787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-15e95a9f-f710-4ca0-b2a0-be3ca9004b82 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1722 microversion: 2.20 time: 0.152226 Oct 19 13:43:42.692339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 420/823] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:42 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:43.567251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15930e1-efde-41f3-a7b7-0da49230281e", "name": "network-vif-deleted", "tag": "31406a49-8592-4d5d-bfb5-20e86e4a83d9"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:43:43.583640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:43.584470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:43.584900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:43.596843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] Creating event network-vif-deleted:31406a49-8592-4d5d-bfb5-20e86e4a83d9 for instance d15930e1-efde-41f3-a7b7-0da49230281e on hv-cinder-86188 Oct 19 13:43:43.601793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-d1b10a1c-1caf-4fba-8188-8a39d1dd0df8 req-fc56486c-dcec-4d39-842b-ea1f39ee227f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038235 Oct 19 13:43:43.604219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 404/824] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:43:43.718267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:43.718982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:43.725303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:43.725990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:43.726678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:43.727540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:43.729063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:43.729726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:43.794169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:43.804850 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:43.806322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:43.808478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-db16f97e-bc8c-4d5f-9a2a-c1ef8249deca tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1365 microversion: 2.20 time: 0.094465 Oct 19 13:43:43.809566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 421/825] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:43 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:44.835920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:44.836617 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:44.842848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:44.843325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:44.843855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:44.844532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:44.845535 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:44.845973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:44.880069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:44.880540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:44.880967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:44.881402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lazy-loading 'fault' on Instance uuid d15930e1-efde-41f3-a7b7-0da49230281e {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:43:44.922454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:44.931236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:44.932699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:44.933872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-206bf8f2-3c7a-4807-8004-b29936d271e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 200 len: 1370 microversion: 2.20 time: 0.103128 Oct 19 13:43:44.934424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 405/826] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:44 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:45.959640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:45.960302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:45.966684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:45.967164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:45.967596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:45.968278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:45.968729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:45.969151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:45.982085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e HTTP/1.1 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:43:45.983728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:43:45.985390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'd15930e1-efde-41f3-a7b7-0da49230281e'} Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:43:45.986298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:43:45.987826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:43:45.989119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:43:45.989119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1bf4f3ac-afc1-4abe-b009-3af0facae830 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 404 len: 111 microversion: 2.20 time: 0.029364 Oct 19 13:43:45.989119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 422/827] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:45 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:43:45.993936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ea7d59e1-e57e-41c7-a241-bdaae9c207c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '.version_select at 0x7fb41e324820>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:46.132001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ea7d59e1-e57e-41c7-a241-bdaae9c207c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852527850" status: 204 len: 0 microversion: 2.20 time: 0.141727 Oct 19 13:43:46.132476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 406/828] 10.222.0.39 () {60 vars in 1259 bytes} [Wed Oct 19 13:43:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852527850 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 13:43:46.882543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5555b48b-fec8-4ec3-8354-659719c2a3b5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: .version_select at 0x7fb41e476dc0>, body: {"keypair": {"name": "tempest-keypair-588467614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG7glrnLDBDyilHod25Pz5+s4QlsezoTB9slPmXdH6+JOuHLyLWa4eYsCxWpLo4qWh4wwF7pMsmq4Feio9YpeSnWnd3+i4tTq6JSbiaXUcekihjoOA258COprHRRs7WvA=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:43:46.898044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-5555b48b-fec8-4ec3-8354-659719c2a3b5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:43:46.902072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-5555b48b-fec8-4ec3-8354-659719c2a3b5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for user 6c828726ae814c0f879a5aa69f647a96 and project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:43:47.018035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5555b48b-fec8-4ec3-8354-659719c2a3b5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.139325 Oct 19 13:43:47.019992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 423/829] 10.222.0.39 () {62 vars in 1200 bytes} [Wed Oct 19 13:43:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 13:43:49.253033 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1266366279", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28483e85-4ae3-42e0-a207-82b7c0da6321"}], "security_groups": [{"name": "tempest-securitygroup--1360447258"}], "key_name": "tempest-keypair-588467614", "user_data": "}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:43:49.355113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] validate_networks() for [('28483e85-4ae3-42e0-a207-82b7c0da6321', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:43:49.708407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:43:49.708830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:43:49.709301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:43:49.709708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:43:49.710116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:43:49.719045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:49.719518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:49.719951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:49.720673 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:49.721136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:49.721549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:49.738052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:43:49.742155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Getting quotas for user 6c828726ae814c0f879a5aa69f647a96 and project bc8fa61ce6ff491b9d497db42d900f50. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:43:49.754000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:43:49.756326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:43:49.882443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-23f3e84c-80ac-4a6c-a742-fb544f113886 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.634173 Oct 19 13:43:49.883177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 407/830] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Oct 19 13:43:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 13:43:49.895807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:49.896416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:49.953694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:49.961204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:49.962694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:49.963782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-534ef2d3-091e-4787-ae9c-e81476652f11 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1281 microversion: 2.20 time: 0.072705 Oct 19 13:43:49.964352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 424/831] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:49 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:50.988761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:50.989331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:50.991318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:50.996699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:50.997336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:50.997779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:50.998526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:50.999002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:50.999434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:51.062038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:51.070089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:51.071567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:51.072688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ae7f905a-5fbf-443f-8abd-46df3720f8de tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1285 microversion: 2.20 time: 0.088557 Oct 19 13:43:51.073231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 408/832] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:50 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:52.097225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:52.097909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:52.100057 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:52.104916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:52.105403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:52.105937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:52.106676 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:52.107132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:52.107555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:52.110174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:52.170986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:52.178799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:52.180233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:52.181324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a8d021b1-f3a3-4c08-997f-2605b872450f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1341 microversion: 2.20 time: 0.088042 Oct 19 13:43:52.181872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 425/833] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:52 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:53.208765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:53.210123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:53.217914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:53.218633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:53.219075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:53.219777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:53.220237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:53.220660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:53.224671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:53.384206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:53.392827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:53.395554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:53.395554 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-72087f83-2fb9-478a-b25c-69edd6e39178 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.191673 Oct 19 13:43:53.396189 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 409/834] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:53 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:53.692207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:43:53.702979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:53.703555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:53.704055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:53.715465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] Creating event network-changed:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:43:53.720287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-e0d06c4c-4cf2-4093-ace1-79727125378c req-bdf9b301-d6df-4c14-ba2a-028ccc7b26bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032409 Oct 19 13:43:53.721089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 426/835] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:43:54.426650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:54.427260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:54.434487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:54.434991 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:54.435458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:54.436180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:54.436630 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:54.437049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:54.752845 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:54.760798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:54.762463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:54.764090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a9cb9ff2-4125-43e0-a5d9-63280052e3b3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.340922 Oct 19 13:43:54.764649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 410/836] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:54 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:55.790193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:55.790905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:55.798571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:55.799049 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:55.799475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:55.800147 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:55.800594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:55.801011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:55.925508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:55.933420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:55.934879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:55.935997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-139f9281-0e90-4c1c-8d5d-dde8f14b79be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.150479 Oct 19 13:43:55.936534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 427/837] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:55 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:43:56.961229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:56.961766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:56.968849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:56.969322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:56.969753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:56.970431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:56.970906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:56.971328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:57.098027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:57.106107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:57.107688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:57.108779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-983cade5-6693-4490-92de-53cb1b7feb9c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.151546 Oct 19 13:43:57.109325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 411/838] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:56 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:58.134678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:58.135267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:58.142324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:58.142836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:58.143274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:58.143958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:58.144412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:58.144829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:58.276569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:58.284968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:58.289719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:58.289719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1e589ef1-4769-4907-8d4c-1472d1f326b7 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.156949 Oct 19 13:43:58.289719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 428/839] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:58 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:43:59.313414 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:59.314049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:59.320589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:59.321067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:59.321498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:59.322180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:59.322656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:59.323079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:59.451682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:59.459725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:59.461160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:59.462290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-66ef2db1-d99f-4df0-bfca-e66e44cc5eab tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.152944 Oct 19 13:43:59.462868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 412/840] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:43:59 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:00.420937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:00.421440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:00.423845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:00.428581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.434371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.434371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.434371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.434371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.434803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.489106 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:00.489612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:00.491464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:00.492125 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:00.497294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.497788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.498232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.499520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.499983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.500413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.511764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'services' on Instance uuid 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:00.632056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:00.640748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:00.642240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:00.648396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e59c660a-b7b5-41e2-baa3-72c886ff39af tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.158241 Oct 19 13:44:00.648396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 413/841] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:00 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:44:00.755190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fbd510bc-ea83-4050-a453-4d0d56ce4595 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments/158feb39-82eb-461a-959a-e041b99b876d" status: 202 len: 0 microversion: 2.1 time: 0.338154 Oct 19 13:44:00.755755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 429/842] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:44:00 2022] DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments/158feb39-82eb-461a-959a-e041b99b876d => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:00.765567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:00.767886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:00.773926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.774445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.774912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.775596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.776048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.776470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.806833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fc764904-073e-466f-a49c-edaffeb8c12c tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Oct 19 13:44:00.807587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 414/843] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:00 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:01.148921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "name": "network-vif-plugged", "status": "completed", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:01.158451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:01.158957 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:01.159386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.170250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] Creating event network-vif-plugged:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:44:01.175489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-3230efff-4192-405a-a824-0989ea5a0099 req-178330cf-8744-4e3e-aa54-7ade185fa155 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030734 Oct 19 13:44:01.176061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 430/844] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:01.669904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:01.670830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:01.678173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:01.678688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:01.679130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.679819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:01.680401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:01.680826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.820313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:01.822719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:01.829411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:01.829898 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:01.830336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.831051 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:01.831509 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:01.831939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.835372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:01.843664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:01.845221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:01.846603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f06c42d4-8fd6-4138-a71f-4160beebeade tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.181049 Oct 19 13:44:01.847172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 415/845] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:01 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:01.862970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-95fc4d95-5ec5-49d4-88a5-9d2243553e35 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047293 Oct 19 13:44:01.863520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 431/846] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:01 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:02.871563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:02.872303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:02.876830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:02.879154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:02.879468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.879947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.880376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.881071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.881520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.881940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.885003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.885488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.885936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.886654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.887110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.887736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.916206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d1d6f389-4cc7-4a15-8491-fc20b63c63d1 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044868 Oct 19 13:44:02.916767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 432/847] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:02 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 13:44:03.007323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:03.007829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:03.014298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.014827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.015455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.016344 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.017111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.017541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.019912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:03.027849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:03.029286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:03.031049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-74f4917f-24fb-4865-9c38-cf693208f925 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1407 microversion: 2.20 time: 0.163398 Oct 19 13:44:03.031691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 416/848] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:02 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:03.043663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:03.336259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-71124c94-8a59-4f9e-896b-2bf8462fc859 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 204 len: 0 microversion: 2.1 time: 0.332511 Oct 19 13:44:03.336855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 433/849] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:44:03 2022] DELETE /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:44:03.345465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:03.346078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:03.352652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.352652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.353039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.353727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.354186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.354646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.483168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:03.490926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fa8389f8-bb57-47ec-9262-62fed6a7705e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1687 microversion: 2.1 time: 0.149825 Oct 19 13:44:03.491493 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 417/850] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:03 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:04.057724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:04.058424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:04.064861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.065341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.065778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.066492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.066979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.067409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.193505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:04.202056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:04.203527 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:04.204678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e0488d9a-d108-4684-86aa-442e03b03bd0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1599 microversion: 2.20 time: 0.151279 Oct 19 13:44:04.205236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 434/851] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:04 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:04.229835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:04.230371 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:04.236661 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.237139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.237573 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.238265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.238740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.241637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.317678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7beff508-bf1a-45e1-8b1d-d46d3dd157be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091840 Oct 19 13:44:04.318272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 418/852] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Oct 19 13:44:04 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:44:04.513153 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:04.513831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:04.520566 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.521048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.521481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.522165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.522644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.523070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.654444 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:04.662168 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cf0d4f6f-dc50-4cd5-bf63-6612c1127074 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1687 microversion: 2.1 time: 0.152888 Oct 19 13:44:04.662763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 435/853] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:04 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:05.413377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:05.423239 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:05.424257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:05.424717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:05.436309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] Creating event network-changed:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:44:05.441447 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-58af0710-4f03-4e9f-9924-d3ecafd999e5 req-e4d4d8c5-3d25-4923-82cc-7d38bbd623a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Oct 19 13:44:05.442037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 419/854] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:05.685045 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:05.685655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:05.692594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:05.693073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:05.693513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:05.694195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:05.694713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:05.695142 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:05.829506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:05.837132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2e5880d7-41f6-4054-9d54-d01c9b1f377a tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1687 microversion: 2.1 time: 0.155923 Oct 19 13:44:05.837702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 436/855] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:05 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:06.861748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:06.862365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:06.868524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:06.869008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:06.869440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:06.870124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:06.870603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:06.871027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:07.158069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:07.165610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-38769752-c164-40dd-83a8-c08d153dac8d tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1687 microversion: 2.1 time: 0.308589 Oct 19 13:44:07.166311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 420/856] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:06 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1687 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:07.802117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a369c01-b0ab-4e73-a911-ecd5f4ceb271", "name": "network-vif-deleted", "tag": "0fd3322a-8dce-48bd-a5f3-1aa4a7981367"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:07.813242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:07.813242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:07.813669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:07.824371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] Creating event network-vif-deleted:0fd3322a-8dce-48bd-a5f3-1aa4a7981367 for instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 on hv-cinder-86188 Oct 19 13:44:07.829434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-c087b865-dd28-470b-bf83-c88d946bd195 req-58e23904-5a3b-49a6-b45b-1d444a9d5600 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Oct 19 13:44:07.830269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 437/857] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:08.189045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:08.189619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:08.196095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:08.196641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:08.197063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:08.197759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:08.198223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:08.198705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:08.232555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:08.233054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:08.233502 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:08.233960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'fault' on Instance uuid 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:08.281188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:08.289141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-85a2e6c5-e060-40f1-9bba-79570c7629be tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 200 len: 1335 microversion: 2.1 time: 0.104190 Oct 19 13:44:08.289719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 421/858] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:08 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:09.319514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:09.320209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 1a369c01-b0ab-4e73-a911-ecd5f4ceb271] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:09.326823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:09.327309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:09.327740 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:09.328420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:09.328871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:09.329290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:09.344295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] HTTP exception thrown: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Request method failure captured: Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 HTTP/1.1 Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z97DcIsQ_Yj_t4gqBEsR_6QQ5NQGSvnfsgsIEqGGOwz-DvZRcPl-dL3hmg4HvhX1KuS3sK5aMUlDU0_ucx7mh4jVyXq71WamPFZfjfieG1gx_fRs4LuobUsUPdtmqs0btq5sTPb6OcZF-OKmGq51PcAhwFzMghs9YDmdYduQbqOwA Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:44:09.345869 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3e2936fe3344e60b6f3dc918b9c738e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 020ff888a8a44d2eb6961829407637a9 Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. Oct 19 13:44:09.347551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '1a369c01-b0ab-4e73-a911-ecd5f4ceb271'} Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:09.348555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. Oct 19 13:44:09.350087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:44:09.351496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Returning 404 to user: Instance 1a369c01-b0ab-4e73-a911-ecd5f4ceb271 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:09.351496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-48a645f8-bba6-45f9-a1d5-f769a05c6234 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271" status: 404 len: 111 microversion: 2.1 time: 0.031904 Oct 19 13:44:09.351496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 438/859] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:09 2022] GET /compute/v2.1/servers/1a369c01-b0ab-4e73-a911-ecd5f4ceb271 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:44:09.355771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-43e9cf84-26ac-41e1-b9bd-0e2f593769e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '.version_select at 0x7fb41e4acdc0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:09.447237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-43e9cf84-26ac-41e1-b9bd-0e2f593769e9 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575202321" status: 202 len: 0 microversion: 2.1 time: 0.095131 Oct 19 13:44:09.447868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 422/860] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575202321 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:12.886466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:12.886985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:12.893496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:12.893979 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:12.894414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:12.895141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:12.895598 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:12.896018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:12.920790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:13.195077 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6aa7b9c7-f121-42af-8b28-6180a5e23c89 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 204 len: 0 microversion: 2.1 time: 0.311986 Oct 19 13:44:13.195584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 439/861] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:44:12 2022] DELETE /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:44:13.204586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:13.205230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:13.211260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:13.211737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:13.212170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:13.212849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:13.213301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:13.214545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:13.339805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:13.347972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c42d920f-1f0a-4a97-8894-1c2f8b96e06b tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1505 microversion: 2.1 time: 0.148394 Oct 19 13:44:13.348529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 423/862] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:13 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:14.372457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:14.373610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:14.382389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:14.383014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:14.383536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:14.384374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:14.384920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:14.385433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:14.400587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:14.519793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:14.527453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8f1a627f-769a-4196-839d-6936c05235aa tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1505 microversion: 2.1 time: 0.160529 Oct 19 13:44:14.528010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 440/863] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:14 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:14.837180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92822db-4152-4a45-ac06-25873b8fb608", "name": "network-vif-deleted", "tag": "875550b0-cee5-41db-a2c8-5e4b2a1406ac"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:14.847175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:14.847659 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:14.848097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:14.864140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] Creating event network-vif-deleted:875550b0-cee5-41db-a2c8-5e4b2a1406ac for instance a92822db-4152-4a45-ac06-25873b8fb608 on hv-cinder-86188 Oct 19 13:44:14.870779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-a6e35941-9f5c-4130-83b3-e62b7a617e93 req-f67a55f3-d437-43be-ab37-7f715b6da51f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037193 Oct 19 13:44:14.871619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 424/864] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:15.551110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:15.551720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:15.558221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:15.558744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:15.559181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:15.559864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:15.560316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:15.560737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:15.591179 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:15.591650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:15.592083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:15.592519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'fault' on Instance uuid a92822db-4152-4a45-ac06-25873b8fb608 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:15.631690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:15.639243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-401b6b22-b50f-40c9-b84a-17b5dfbfba98 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 200 len: 1311 microversion: 2.1 time: 0.092021 Oct 19 13:44:15.639799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 441/865] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:15 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:16.663874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:16.664609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: a92822db-4152-4a45-ac06-25873b8fb608] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:16.671090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.671571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.672614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.673303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.673760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.674186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.687128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] HTTP exception thrown: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Request method failure captured: Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 HTTP/1.1 Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z97DcIsQ_Yj_t4gqBEsR_6QQ5NQGSvnfsgsIEqGGOwz-DvZRcPl-dL3hmg4HvhX1KuS3sK5aMUlDU0_ucx7mh4jVyXq71WamPFZfjfieG1gx_fRs4LuobUsUPdtmqs0btq5sTPb6OcZF-OKmGq51PcAhwFzMghs9YDmdYduQbqOwA Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:44:16.688723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3e2936fe3344e60b6f3dc918b9c738e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 020ff888a8a44d2eb6961829407637a9 Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. Oct 19 13:44:16.690336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'a92822db-4152-4a45-ac06-25873b8fb608'} Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:16.691284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. Oct 19 13:44:16.692721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:16.694081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Returning 404 to user: Instance a92822db-4152-4a45-ac06-25873b8fb608 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:16.694081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e7d5b844-9681-423c-8c4a-cc5e72076ecf tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608" status: 404 len: 111 microversion: 2.1 time: 0.030894 Oct 19 13:44:16.694081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 425/866] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:16 2022] GET /compute/v2.1/servers/a92822db-4152-4a45-ac06-25873b8fb608 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:44:16.698459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:16.699035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:16.705481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.705965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.706407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.707128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.707606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.708034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.733188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:17.012197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-63cfbad5-58f9-4f38-8314-c393e452e04e tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 204 len: 0 microversion: 2.1 time: 0.317247 Oct 19 13:44:17.012786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 442/867] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:44:16 2022] DELETE /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:44:17.021541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:17.022155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:17.028142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:17.028636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:17.029078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:17.029766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:17.030226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:17.030724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:17.155875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:17.164279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fbc1383b-dd41-4551-8655-d6bb6a5073a7 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.146595 Oct 19 13:44:17.164836 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 426/868] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:17 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:18.188133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:18.188825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:18.195246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:18.195724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:18.196156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:18.196835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:18.197282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:18.197740 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:18.326867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:18.334927 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5a224b83-a894-4e32-95a9-066897e7e4b2 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1521 microversion: 2.1 time: 0.151185 Oct 19 13:44:18.335609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 443/869] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:18 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:18.682380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999a9976-a51e-4933-8342-5c862b9a574a", "name": "network-vif-deleted", "tag": "293c7801-b3d7-4169-b547-c04ea8e9fe4d"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:18.693663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:18.697230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:18.697230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:18.706396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] Creating event network-vif-deleted:293c7801-b3d7-4169-b547-c04ea8e9fe4d for instance 999a9976-a51e-4933-8342-5c862b9a574a on hv-cinder-86188 Oct 19 13:44:18.711360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-b58585b6-b530-4414-8a53-2cd4495d9175 req-9c282cb0-6113-43dd-bc5a-adb307295b37 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032748 Oct 19 13:44:18.711950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 427/870] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:19.358277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:19.358922 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:19.365746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:19.366223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:19.366696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:19.367374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:19.367818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:19.368232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:19.400167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:19.400633 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:19.401089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:19.401519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lazy-loading 'fault' on Instance uuid 999a9976-a51e-4933-8342-5c862b9a574a {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:19.443798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '020ff888a8a44d2eb6961829407637a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e2936fe3344e60b6f3dc918b9c738e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:19.451348 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ec1885b2-bc46-402b-b593-b517c49a3ba4 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 200 len: 1312 microversion: 2.1 time: 0.096942 Oct 19 13:44:19.451901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 444/871] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:19 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:20.475672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:20.476367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] [instance: 999a9976-a51e-4933-8342-5c862b9a574a] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:20.482489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:20.483004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:20.483438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:20.484121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:20.484574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:20.485679 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:20.498717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] HTTP exception thrown: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Request method failure captured: Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a HTTP/1.1 Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z97DcIsQ_Yj_t4gqBEsR_6QQ5NQGSvnfsgsIEqGGOwz-DvZRcPl-dL3hmg4HvhX1KuS3sK5aMUlDU0_ucx7mh4jVyXq71WamPFZfjfieG1gx_fRs4LuobUsUPdtmqs0btq5sTPb6OcZF-OKmGq51PcAhwFzMghs9YDmdYduQbqOwA Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:44:20.500365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3e2936fe3344e60b6f3dc918b9c738e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3e2936fe3344e60b6f3dc918b9c738e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: a3e2936fe3344e60b6f3dc918b9c738e Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318870398 Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 020ff888a8a44d2eb6961829407637a9 Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318870398-project Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. Oct 19 13:44:20.501976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '999a9976-a51e-4933-8342-5c862b9a574a'} Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:20.502909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. Oct 19 13:44:20.504422 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:20.505700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] Returning 404 to user: Instance 999a9976-a51e-4933-8342-5c862b9a574a could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:20.505700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-74d7041e-d444-4f8d-adb7-3daedbac9e58 tempest-ServerRescueNegativeTestJSON-1318870398 tempest-ServerRescueNegativeTestJSON-1318870398-project] 10.222.0.39 "GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a" status: 404 len: 111 microversion: 2.1 time: 0.030754 Oct 19 13:44:20.505700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 428/872] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:20 2022] GET /compute/v2.1/servers/999a9976-a51e-4933-8342-5c862b9a574a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:44:25.222748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:25.223260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:25.225535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:25.230172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.230814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.231254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.231948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.232382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.232802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.261380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:25.531767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4d86b61b-1813-4077-bafe-257e133a42fd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 204 len: 0 microversion: 2.1 time: 0.313167 Oct 19 13:44:25.532291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 445/873] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:44:25 2022] DELETE /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:44:25.540902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:25.541508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:25.544281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:25.549847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.550343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.550790 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.551508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.552019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.552514 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.557438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=94 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:25.686492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:25.694193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-60061ed6-d521-4428-b2ca-89277497f7bc tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1578 microversion: 2.1 time: 0.157268 Oct 19 13:44:25.694838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 429/874] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:25 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:26.717793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:26.718685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:26.725306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:26.725777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:26.726206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:26.726911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:26.727359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:26.727774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:26.932191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:26.939858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b083d045-c373-4651-b2da-c3d5ef4eaa52 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1578 microversion: 2.1 time: 0.226314 Oct 19 13:44:26.940426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 446/875] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:26 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:27.965517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:27.967347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:27.978423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:27.979195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:27.980526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:27.981411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:27.982626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:27.983266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:28.163749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:28.176284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d3859c31-fbd6-44c6-b522-87282e06a846 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1578 microversion: 2.1 time: 0.217294 Oct 19 13:44:28.177027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 430/876] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:27 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:28.524232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530fa5a-76ad-4149-99bd-909c686e1e79", "name": "network-vif-deleted", "tag": "77511b14-976b-4336-8b31-a9eb1f588505"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:28.542791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:28.543778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:28.544390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:28.558369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] Creating event network-vif-deleted:77511b14-976b-4336-8b31-a9eb1f588505 for instance 5530fa5a-76ad-4149-99bd-909c686e1e79 on hv-cinder-86188 Oct 19 13:44:28.565055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-4f381c28-aa37-4ffa-837b-e48aa7a6aacf req-fc6738e0-97dd-4327-b9fd-69f427090cd3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045696 Oct 19 13:44:28.566776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 447/877] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:29.206714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:29.207589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:29.223646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:29.223646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:29.223646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:29.223646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:29.224192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:29.224192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:29.284000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:29.291841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f0717c7c-1450-495c-9123-640d99dcf90d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1225 microversion: 2.1 time: 0.090690 Oct 19 13:44:29.292394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 431/878] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:29 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:30.319678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:30.321307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:30.334357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:30.335238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:30.335790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:30.340054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:30.343429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:30.346415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:30.396715 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:30.397247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:30.397734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:30.398156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lazy-loading 'fault' on Instance uuid 5530fa5a-76ad-4149-99bd-909c686e1e79 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:30.442876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:30.451777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7ebd4cef-c0b5-4f9f-a0aa-4e68484d37c0 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 200 len: 1230 microversion: 2.1 time: 0.139198 Oct 19 13:44:30.453134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 448/879] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:30 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 1230 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:31.475903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:31.476525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:31.483285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.486948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.487541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.488674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.489474 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.490063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.509916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] HTTP exception thrown: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Request method failure captured: Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 HTTP/1.1 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_4MmY2FeTQgF_kDfmKIeq6YwETcSYiSLBlvTNMM89KO7pSX637HAgjgBZUZFee0VRgLqgFHwJuvc4szVPX_t8d3hhJ47-jPuVX3PPHte3fJLxoxb7Tz9alJiEmd-tzqsi348huN-uyg4rJYI2PrreGb7x4Ih3bb3mDQjBMUPJd9Shk Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:44:31.512331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a1c12d9a4454de59ed63d3cedb71a58", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: e7a6ae7333d2422ebc9f616d482e527a Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:44:31.513703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '5530fa5a-76ad-4149-99bd-909c686e1e79'} Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:31.514545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:44:31.515902 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:31.518781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Returning 404 to user: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:31.519973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fe00e83a-9778-4915-90d7-69a674d2a434 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 404 len: 111 microversion: 2.1 time: 0.047792 Oct 19 13:44:31.521155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 432/880] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:31 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:44:31.694226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1792337194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-857404674", "security_groups": [{"name": "tempest-secgroup-smoke-2085292027"}], "block_device_mapping_v2": [{"uuid": "f8987f0e-665d-4d3c-8e3a-83e346b021d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac"}]}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:31.764056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-19b4117f-d67b-4cfc-a961-2afb3d34d087 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: .version_select at 0x7fb41e4940d0>, body: {"keypair": {"name": "tempest-keypair-204629068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/OtWJlZW15Wza1g7hRXmxU7XIH/pSlkxFEjye7sqawHu6JLSytf+4fCbNdaeDeUELosmiz+91e7LtHkSRq5ohhuJZ8ntmLdbjpTaKEBDkoJCStMv7ZKCOGkTd0gg1ZNw=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:31.785502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-19b4117f-d67b-4cfc-a961-2afb3d34d087 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:44:31.789916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-19b4117f-d67b-4cfc-a961-2afb3d34d087 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for user c996056bd0354124ae74e79abf2753a8 and project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:44:31.819406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] validate_networks() for [('11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:44:31.868236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-19b4117f-d67b-4cfc-a961-2afb3d34d087 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.274224 Oct 19 13:44:31.874848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 449/881] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:44:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:32.190958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:44:32.191383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:44:32.191859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:44:32.192270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:44:32.192683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:44:32.202050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:32.202564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:32.207107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:32.207107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:32.207107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:32.207107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:32.224143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:44:32.228531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for user e7a6ae7333d2422ebc9f616d482e527a and project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:44:32.305031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:44:32.306104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8987f0e-665d-4d3c-8e3a-83e346b021d2',volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:44:32.737980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5ced3a9b-bf02-4bc3-b462-d1d689b75c89 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.047730 Oct 19 13:44:32.739528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 433/882] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:44:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 13:44:32.751526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7c549b63-02b2-4432-a86e-451c98833fb6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:32.753895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7c549b63-02b2-4432-a86e-451c98833fb6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:32.809453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7c549b63-02b2-4432-a86e-451c98833fb6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:32.831150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7c549b63-02b2-4432-a86e-451c98833fb6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1094 microversion: 2.1 time: 0.084175 Oct 19 13:44:32.832039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 450/883] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:32 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:33.857061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:33.857749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:33.864110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:33.869248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:33.869248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:33.869248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:33.869248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:33.869637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:33.936668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:33.945004 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-411a3d3f-7031-4d39-9b05-c7a8f3a797f7 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1144 microversion: 2.1 time: 0.092344 Oct 19 13:44:33.946550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 434/884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:33 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:34.150165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2068608888", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ced57eb0-c373-4819-a5ad-31424570b450"}], "security_groups": [{"name": "tempest-securitygroup--1679686174"}], "key_name": "tempest-keypair-204629068", "user_data": "}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:34.269777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] validate_networks() for [('ced57eb0-c373-4819-a5ad-31424570b450', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:44:34.929028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:44:34.929524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:44:34.930065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:44:34.930568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:44:34.931048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:44:34.940505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:34.940984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:34.941414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:34.942134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:34.942684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:34.943109 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:34.962822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:44:34.966529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for user c996056bd0354124ae74e79abf2753a8 and project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:44:34.968259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:34.968886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:34.976143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:34.983379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:34.983379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:34.983379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:34.983379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:34.983760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:34.983851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:44:34.984353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:44:35.052032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:35.058675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c76d92bb-13cd-40e7-ac4b-4aaa121a0096 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1192 microversion: 2.1 time: 0.094508 Oct 19 13:44:35.059241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 435/885] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:34 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:35.116443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b70b0242-9c59-4981-89c2-74b220c1a7e8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.970804 Oct 19 13:44:35.117090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 451/886] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:44:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:44:35.130650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4691d81f-bf19-4089-be5d-a6c8c3e162ce tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:35.130650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4691d81f-bf19-4089-be5d-a6c8c3e162ce tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:35.185236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4691d81f-bf19-4089-be5d-a6c8c3e162ce tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:35.192097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4691d81f-bf19-4089-be5d-a6c8c3e162ce tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1237 microversion: 2.1 time: 0.067687 Oct 19 13:44:35.192660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 436/887] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:35 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:36.082872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:36.083489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:36.089488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:36.089970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:36.090404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:36.091115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:36.091569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:36.091992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:36.156087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:36.164541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-26f27c7c-efb6-40c5-bfd5-ccce34044a22 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1210 microversion: 2.1 time: 0.086898 Oct 19 13:44:36.165116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 452/888] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:36 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:36.215374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:36.216163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:36.226986 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:36.227763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:36.228202 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:36.229209 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:36.229886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:36.230567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:36.331144 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:36.339115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ceaf1482-91b1-40af-97f5-42b84f9287fa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1241 microversion: 2.1 time: 0.127783 Oct 19 13:44:36.340258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 437/889] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:36 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:37.187963 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:37.188577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:37.195324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:37.195807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:37.196249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:37.196932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:37.197386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:37.197848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:37.284315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e034f877-4abe-4014-8097-62fd05e67978", "tag": "2ff93784-b640-46c6-b8f6-cf8b1abac5f5"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:37.294848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:37.295096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:37.295527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:37.307234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] Creating event network-changed:2ff93784-b640-46c6-b8f6-cf8b1abac5f5 for instance e034f877-4abe-4014-8097-62fd05e67978 on hv-cinder-86188 Oct 19 13:44:37.312391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-3eea9c1c-195b-46c0-9392-0692e21e6687 req-9693358a-28ac-4f5f-b6d7-4655f499e552 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Oct 19 13:44:37.313167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 438/890] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:37.328675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:37.336378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7367db3b-71b2-4f1e-83a2-8d13e5c80c75 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.152187 Oct 19 13:44:37.336948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 453/891] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:37 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:37.364037 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:37.364679 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:37.370897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:37.375879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:37.375879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:37.375879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:37.375879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:37.376878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:37.440518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:37.448429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bac3a4dd-44fb-447f-bf1d-06d64a032adc tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1289 microversion: 2.1 time: 0.089251 Oct 19 13:44:37.449118 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 439/892] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:37 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:38.359368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:38.359971 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:38.367128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:38.367613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:38.368073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:38.368972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:38.369437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:38.369855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:38.475134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:38.475771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:38.483063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:38.483550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:38.484168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:38.485344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:38.486434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:38.486907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:38.504605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:38.513166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-41a1050d-810c-4331-8c40-c4a8c528780b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.157756 Oct 19 13:44:38.526924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 454/893] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:38 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:38.567590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:38.576192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f899e924-ffa5-48e0-beba-1425ce975984 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1295 microversion: 2.1 time: 0.105782 Oct 19 13:44:38.577067 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 440/894] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:38 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1295 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:39.363460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-795761644"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:39.363980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:39.370277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.370779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.371219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.371893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.372337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.372761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.494122 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.network.security_group_api [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Removing security group 48b42a5e-20d9-42a9-a8ac-a308894b545b from port 88b37321-a984-4072-8e27-c154509a5b29 Oct 19 13:44:39.537460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:39.538074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:39.545056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.545548 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.545982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.546702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.547154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.547578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.688433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:39.696151 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5997ab63-6670-4955-a897-582c945c4eb4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.162723 Oct 19 13:44:39.696727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 441/895] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:39 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:39.701307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:39.701911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:39.707684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.708168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.708605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.709299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.709757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.710180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.839101 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:39.846690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e029e270-fafa-4d03-9ade-4efbaeb87daa tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.148998 Oct 19 13:44:39.848723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 442/896] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:39 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:39.864086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d11e4e4b-9b31-42fd-875c-f68e7f8f97f2 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action" status: 202 len: 0 microversion: 2.1 time: 0.505012 Oct 19 13:44:39.864854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 455/897] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:44:39 2022] POST /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:39.890871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:39.904953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:39.905721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:39.906328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:39.921302 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] Creating event network-changed:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:44:39.927756 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-4a1aaf98-9b93-43f4-9d39-aaa3f6ef5f49 req-94b74fc3-e012-4f2a-8643-c519f50c6454 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042578 Oct 19 13:44:39.929338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 443/898] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:40.719201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:40.720491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:40.727309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:40.728020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:40.728634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:40.729344 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:40.729795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:40.730214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:40.754541 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:40.872603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:40.873508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:40.880529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:40.881158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:40.881711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:40.882540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:40.883268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:40.883760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:40.961267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:40.969373 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4a7dbc9a-bca9-4043-9c94-9b44f0729886 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.254281 Oct 19 13:44:40.970872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 456/899] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:40 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:41.157884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:41.169011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c3bc0b29-87a7-4bdb-b6f9-d7ea2501ecb9 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.299828 Oct 19 13:44:41.186688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 444/900] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:40 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:41.189488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:41.190053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:41.197269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.197855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.198559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.199312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.199833 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.200253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.291466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lazy-loading 'services' on Instance uuid 12c6244e-bda8-4148-a595-94c64b243878 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:41.390030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9ddd46-d529-42b2-946f-aa49eb37a00d", "tag": "c44cee20-ef54-4c0d-a74a-7a2bb797b1d3"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:41.401291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.402145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.402726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.415665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] Creating event network-changed:c44cee20-ef54-4c0d-a74a-7a2bb797b1d3 for instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d on hv-cinder-86188 Oct 19 13:44:41.420688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-2c576b82-00cb-4791-a6e1-b6cf1698f307 req-a4f8382e-1e31-40c3-8a3c-605e87b52dbc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035807 Oct 19 13:44:41.421381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 445/901] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:41.531559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c5d030e8-57d2-428b-89ee-7494e38e1b27 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments/ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f" status: 202 len: 0 microversion: 2.1 time: 0.346724 Oct 19 13:44:41.536062 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 457/902] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:44:41 2022] DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments/ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:41.541988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:41.544706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:41.553187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.553955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.554615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.555482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.556093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.556692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.588958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2ff058d4-5730-4d96-8d64-7571b982230c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051183 Oct 19 13:44:41.590314 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 446/903] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:41 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:41.945670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:41.956336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:41.956811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:41.957237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:41.967999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] Creating event network-changed:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:44:41.973013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-9e9cab60-d494-46e7-b792-689612c08319 req-28afa1dd-d06e-4507-9f11-ad23cf070b10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031290 Oct 19 13:44:41.973582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 458/904] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:41.994557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:41.995203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:42.002574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.003066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.003705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.004415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.004871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.005300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.140983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:42.150221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5f5b0b7f-e390-45c5-b7ad-9166e2561aea tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.159513 Oct 19 13:44:42.150830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 447/905] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:41 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:42.194639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:42.195341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:42.201801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.202488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.203148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.203880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.204337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.204930 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.355022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:42.358050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-88b7e6e4-c1e4-4a47-93ea-245a226c0a7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.167608 Oct 19 13:44:42.358642 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 459/906] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:42 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:42.602417 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:42.605754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:42.608277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:42.613603 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.614090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.614956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.615943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:42.616400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:42.616825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:42.650081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cfbd733d-2bcd-4bc3-8e98-61006c409a59 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Oct 19 13:44:42.651092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 448/907] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:42 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:43.174181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:43.174732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:43.181818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.182306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.182784 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.183466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.183926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.184347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.367125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:43.374803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ad52cbf2-7a8b-40b9-b6a2-4cc410d4fe5a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.205373 Oct 19 13:44:43.375397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 460/908] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:43 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:43.381935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:43.382566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:43.388861 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.389339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.389772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.390451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.390928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.391352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.516432 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:43.524184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7179cef5-9163-460c-96f8-b0f9b79f6e7e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.146164 Oct 19 13:44:43.524741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 449/909] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:43 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:43.664438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:43.666639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:43.673673 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.674154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.674641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.680206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.680206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.680206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.705233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-afa46303-4042-4b28-a55b-1efd4b94eb1c tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045052 Oct 19 13:44:43.708828 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 461/910] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:44:43 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:44:43.717617 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:43.718116 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:43.724631 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.725113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.725546 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.726230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:43.726745 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:43.727173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:43.730945 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:43.851460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] HTTP exception thrown: Instance 12c6244e-bda8-4148-a595-94c64b243878 is not attached to volume ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Request method failure captured: Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments/ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f HTTP/1.1 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_4XIocu4cJOwrP-jMUWH_aU-2jHtm_kZ68v2RGe8PQGyPdHZtrRlKsxGt11HYRX6wvXMEMeRrCgZtw59lYI1yVaKoJYoqKOrcIelbGTD9eyM_-bBdDo8bixtxE1cLRWbsupLU-KK7zNxcJMRnZAIfS3XFmYect8sxO1126ab74AgU4 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 4cb6b4edda314963acad175089204599 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:44:43.854060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cb6b4edda314963acad175089204599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4cb6b4edda314963acad175089204599", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4cb6b4edda314963acad175089204599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cb6b4edda314963acad175089204599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 4cb6b4edda314963acad175089204599 Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestMinimumBasicScenario-393744747-project Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 906899df35c14f9eb20415c513a8b599 Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestMinimumBasicScenario-393744747-project Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:44:43.855652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 12c6244e-bda8-4148-a595-94c64b243878 is not attached to volume ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'server_id': '12c6244e-bda8-4148-a595-94c64b243878', 'id': 'ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f'} Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f. Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:43.856522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c6244e-bda8-4148-a595-94c64b243878 is not attached to volume ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c6244e-bda8-4148-a595-94c64b243878 is not attached to volume ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:43.857995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Returning 404 to user: Instance 12c6244e-bda8-4148-a595-94c64b243878 is not attached to volume ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:43.859146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5585e735-9df4-43f4-9c4c-1d0687a4c396 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments/ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f" status: 404 len: 154 microversion: 2.1 time: 0.142008 Oct 19 13:44:43.859146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 450/911] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:44:43 2022] DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878/os-volume_attachments/ba1bbf52-d6f8-40e5-b7a1-627f2e822a3f => generated 154 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:44:44.398086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:44.398720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:44.405281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:44.405767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:44.406199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:44.406918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:44.407447 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:44.407871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:44.534823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:44.542578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c18fe888-7a6f-4f16-9289-89b3ff3a1e07 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.148173 Oct 19 13:44:44.543139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 462/912] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:44 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:44.548379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:44.549009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:44.555655 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:44.556139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:44.556576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:44.557257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:44.557710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:44.558133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:44.686073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:44.694312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-64f9ca14-aa03-49e5-8c6a-0331be5ba41a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.150572 Oct 19 13:44:44.694906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 451/913] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:44 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:45.202166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:45.202696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:45.204636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:45.205455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=12 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:45.210187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.210708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.211148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.211832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.212290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.212711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.236855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:45.485563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cbe7db72-fa0d-451a-9f68-ab2e4fb74d6f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 204 len: 0 microversion: 2.1 time: 0.286997 Oct 19 13:44:45.486251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 463/914] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:44:45 2022] DELETE /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:44:45.494299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:45.494943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:45.496829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=8 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:45.501734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.502214 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.502691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.503394 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.503908 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.504299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.566336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:45.567178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:45.573152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.573637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.578297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.578297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.578297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.578297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.634257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:45.642169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1a9dd196-e456-4a9d-aeae-1a9d6aa8e3cc tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1675 microversion: 2.1 time: 0.151666 Oct 19 13:44:45.642766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 452/915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:45 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:45.710315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:45.716862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:45.717473 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:45.718159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-75812ee9-d156-4101-95f9-8f5cdd5d0a8b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.156584 Oct 19 13:44:45.718751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 464/916] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:45 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:45.723361 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.723843 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.724277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.724970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:45.725425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:45.725850 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:45.852897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:45.860441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-82a2004c-c594-4f6d-9fdb-a0146b0fae1d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.147377 Oct 19 13:44:45.861001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 453/917] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:45 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:46.665778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:46.666390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:46.673195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.673678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.674112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:46.675472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.675908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.676328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:46.741943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:46.742682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:46.749121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.749606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.750215 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:46.750766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.751232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.751645 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:46.802295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:46.809999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-47205f1e-55a5-4cde-951a-c68939336390 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1556 microversion: 2.1 time: 0.148090 Oct 19 13:44:46.810578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 465/918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:46 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:46.885263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:46.885413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:46.885547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:46.889575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.890054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.890488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:46.891196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:46.891324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9385c243-9fa6-4f8a-99c9-f9b8ffea6789 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.153935 Oct 19 13:44:46.891646 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:46.891889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 454/919] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:46 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:46.892218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:47.019658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:47.027563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f6dea14a-2912-4e7f-9034-1009ba1742c6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.148425 Oct 19 13:44:47.028132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 466/920] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:46 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:47.833407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:47.834036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:47.840427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:47.840908 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:47.841336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:47.842054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:47.842525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:47.842946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:47.914381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:47.915061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:47.921921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:47.922400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:47.922862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:47.923548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:47.923993 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:47.924411 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:47.973693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:47.981702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b14402b9-8761-4999-8a82-9dafe78ac070 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1556 microversion: 2.1 time: 0.152689 Oct 19 13:44:47.982265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 455/921] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:47 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:48.050958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:48.051575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:48.057400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:48.057529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:48.057875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:48.058309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:48.059085 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:48.059543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:48.059964 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:48.065728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1e8d9887-8b28-4d25-80e1-8cc3345d483a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.154673 Oct 19 13:44:48.066293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 467/922] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:47 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:48.186744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:48.194920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0fe2c868-2b22-4ad8-96d4-941986d632e1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.148003 Oct 19 13:44:48.195503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 456/923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:48 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:49.005071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:49.005763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:49.012734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.013326 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.013852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.014762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.015220 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.015636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.088786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:49.090014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:49.097483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.098137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.098960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.100011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.100469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.100897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.156031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:49.164514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a05a7ef3-a8ea-4d5f-bebb-3b450ef62ac4 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1556 microversion: 2.1 time: 0.163327 Oct 19 13:44:49.165805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 468/924] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:48 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:49.218720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:49.219339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:49.226909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.227683 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.228183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.228809 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.229256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.230009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.245881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:49.255586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e0a893f6-a938-424f-8870-19573f60f920 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.171072 Oct 19 13:44:49.258781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 457/925] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:49 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:49.265274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9ddd46-d529-42b2-946f-aa49eb37a00d", "name": "network-vif-plugged", "status": "completed", "tag": "c44cee20-ef54-4c0d-a74a-7a2bb797b1d3"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:49.276712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:49.277637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:49.278253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:49.293767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] Creating event network-vif-plugged:c44cee20-ef54-4c0d-a74a-7a2bb797b1d3 for instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d on hv-cinder-86188 Oct 19 13:44:49.299369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-9f8b2543-301a-4bde-913e-1019f0641a0b req-b540204c-5698-48ea-919e-c5172704095e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038738 Oct 19 13:44:49.300277 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 458/926] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:49.365487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:49.373296 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-77788d7b-fb96-42a6-9cc5-6a8efde8f99a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.158744 Oct 19 13:44:49.373864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 469/927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:49 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:50.189928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:50.191150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:50.197780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.198255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.198754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.199439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.199888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.200308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.272531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:50.280573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:50.281196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:50.287885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.290597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.290597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.290597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.290886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a396893e-de3f-479f-8e7f-019a348fd763 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1514 microversion: 2.1 time: 0.104951 Oct 19 13:44:50.291083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.291083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.302799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 459/928] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:50 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1514 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:50.362645 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c6244e-bda8-4148-a595-94c64b243878", "name": "network-vif-deleted", "tag": "88b37321-a984-4072-8e27-c154509a5b29"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:50.372002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.372477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.376652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.384534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] Creating event network-vif-deleted:88b37321-a984-4072-8e27-c154509a5b29 for instance 12c6244e-bda8-4148-a595-94c64b243878 on hv-cinder-86188 Oct 19 13:44:50.390595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-cdf8d9d8-f858-491b-9ead-1c5338145589 req-eb05f105-3b67-4ced-b1cd-acaeebadc52c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Oct 19 13:44:50.390595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 460/929] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:50.396406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:50.397193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:50.403272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.403754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.404188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.404876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:50.405356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:50.405781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:50.440533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:50.445414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7e737703-b094-46a2-9006-8067a4c3769e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.168440 Oct 19 13:44:50.445998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 470/930] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:50 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:50.540598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:50.548715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5a1381f7-e262-4683-939c-6eb98f019a2e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.156807 Oct 19 13:44:50.549243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 461/931] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:50 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:51.316602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:51.318148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:51.324969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.325476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.326096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.326830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.327280 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.327702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.344324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e034f877-4abe-4014-8097-62fd05e67978", "name": "network-vif-plugged", "status": "completed", "tag": "2ff93784-b640-46c6-b8f6-cf8b1abac5f5"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:51.345983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:51.356084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.356649 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.357089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.363885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.364359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.364788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.365221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lazy-loading 'fault' on Instance uuid 12c6244e-bda8-4148-a595-94c64b243878 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:51.369731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] Creating event network-vif-plugged:2ff93784-b640-46c6-b8f6-cf8b1abac5f5 for instance e034f877-4abe-4014-8097-62fd05e67978 on hv-cinder-86188 Oct 19 13:44:51.375053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-a3f3745e-1da2-48fe-9959-ae66dcc36b2d req-d87f6721-e8c0-4793-97d1-dcee8d345a19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034722 Oct 19 13:44:51.375912 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 462/932] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:51.407790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:51.416473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4dd4b1b1-3a5f-47e9-a36c-646657d79f2f tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1349 microversion: 2.1 time: 0.104689 Oct 19 13:44:51.417030 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 471/933] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:51 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:51.469069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:51.475953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:51.476629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.477117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.477561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.478253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.478761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.479181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.572345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:51.573723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:51.582622 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.583191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.583626 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.584328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:51.584916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:51.585386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:51.615896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:51.625250 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-50deb45c-7172-4e96-9559-9553d9dc30b6 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.160259 Oct 19 13:44:51.626175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 463/934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:51 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:51.720556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:51.728143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-97949e19-9c11-42f5-a35c-5e8b526cc336 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1363 microversion: 2.1 time: 0.160635 Oct 19 13:44:51.742528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 472/935] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:51 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:52.439725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:52.440860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:52.447365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.447838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.448266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.448945 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.449396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.449815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.480070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.480537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.481006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.481451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lazy-loading 'fault' on Instance uuid 12c6244e-bda8-4148-a595-94c64b243878 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:44:52.520780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906899df35c14f9eb20415c513a8b599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cb6b4edda314963acad175089204599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:52.528503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-760c2e74-abac-4870-a951-2e0397f0cf4e tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 200 len: 1349 microversion: 2.1 time: 0.092840 Oct 19 13:44:52.529051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 464/936] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:52 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:52.649772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:52.650413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:52.653030 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:52.657896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.658372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.658828 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.659512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.659965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.660385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.751412 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:52.752020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:52.759866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.760352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.760811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.761504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.761953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.762948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.791593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:52.802307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-86621175-cd9a-43b3-a323-6ffc1d8a1afe tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.156421 Oct 19 13:44:52.808905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 473/937] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:52 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:52.891212 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:52.899316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a0dcd816-4535-4470-a5b1-98e9e6767f93 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1550 microversion: 2.1 time: 0.151852 Oct 19 13:44:52.900046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 465/938] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:52 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:44:52.921932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:52.922430 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:52.928982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.929465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.929902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:52.930611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:52.931069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:52.931498 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:53.006229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1f64d9d8-5e93-4365-baf7-20ef3307c18f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088434 Oct 19 13:44:53.006849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 474/939] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:44:52 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:53.551220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:53.551888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] [instance: 12c6244e-bda8-4148-a595-94c64b243878] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:53.558286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:53.558801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:53.559241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:53.559970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:53.560598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:53.561032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:53.574967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] HTTP exception thrown: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Request method failure captured: Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 HTTP/1.1 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_4XIocu4cJOwrP-jMUWH_aU-2jHtm_kZ68v2RGe8PQGyPdHZtrRlKsxGt11HYRX6wvXMEMeRrCgZtw59lYI1yVaKoJYoqKOrcIelbGTD9eyM_-bBdDo8bixtxE1cLRWbsupLU-KK7zNxcJMRnZAIfS3XFmYect8sxO1126ab74AgU4 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 4cb6b4edda314963acad175089204599 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:44:53.576622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cb6b4edda314963acad175089204599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4cb6b4edda314963acad175089204599", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4cb6b4edda314963acad175089204599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cb6b4edda314963acad175089204599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 4cb6b4edda314963acad175089204599 Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393744747 Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestMinimumBasicScenario-393744747-project Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 906899df35c14f9eb20415c513a8b599 Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestMinimumBasicScenario-393744747-project Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. Oct 19 13:44:53.578014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '12c6244e-bda8-4148-a595-94c64b243878'} Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:53.579471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. Oct 19 13:44:53.581397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:44:53.587752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Returning 404 to user: Instance 12c6244e-bda8-4148-a595-94c64b243878 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:53.587752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-59b1ccb4-3aa9-4f1b-b29b-98d9039bd180 tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878" status: 404 len: 111 microversion: 2.1 time: 0.030812 Oct 19 13:44:53.587752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 466/940] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:53 2022] GET /compute/v2.1/servers/12c6244e-bda8-4148-a595-94c64b243878 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:44:53.589399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fa32baf4-3f2e-45e5-b798-d8245d21160b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] Calling method '.version_select at 0x7fb41e3d8b80>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:53.680778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fa32baf4-3f2e-45e5-b798-d8245d21160b tempest-TestMinimumBasicScenario-393744747 tempest-TestMinimumBasicScenario-393744747-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2006773446" status: 202 len: 0 microversion: 2.1 time: 0.097005 Oct 19 13:44:53.681454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 475/941] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Oct 19 13:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2006773446 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:53.825806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:53.826445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:53.833020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:53.833523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:53.833967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:53.834863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:53.835490 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:53.835926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:53.990602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:54.001348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8ee21b85-2a36-4cdd-87b5-fbcf0ab4c8bd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1266 microversion: 2.1 time: 0.178651 Oct 19 13:44:54.012882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 467/942] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:53 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:54.225222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9ddd46-d529-42b2-946f-aa49eb37a00d", "tag": "c44cee20-ef54-4c0d-a74a-7a2bb797b1d3"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:54.235706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:54.236187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:54.236618 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:54.248667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] Creating event network-changed:c44cee20-ef54-4c0d-a74a-7a2bb797b1d3 for instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d on hv-cinder-86188 Oct 19 13:44:54.254098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-f06f52c2-d6c3-4f35-8892-07ff900a9c98 req-e2ca8897-cf67-4067-9db9-fefe8cfb4312 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033552 Oct 19 13:44:54.254704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 476/943] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:55.025128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:55.026344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:55.033020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:55.034001 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:55.034693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:55.035593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:55.036493 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:55.037106 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:55.180020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:55.188906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a99f0dcf-5dd6-48c7-a968-1086ac8811af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1454 microversion: 2.1 time: 0.167389 Oct 19 13:44:55.189803 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 468/944] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:55 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:55.213514 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:55.215084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:55.223146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:55.223920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:55.227640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:55.227640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:55.227640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:55.227640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:55.452663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:55.460624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-181d1566-e53b-47bf-9076-f0a07d3e0146 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1454 microversion: 2.1 time: 0.251181 Oct 19 13:44:55.470538 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 477/945] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:55 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1454 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:57.820896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e034f877-4abe-4014-8097-62fd05e67978", "tag": "2ff93784-b640-46c6-b8f6-cf8b1abac5f5"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:57.829289 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:57.833700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:57.834180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:57.834755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:57.837539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:57.849372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] Creating event network-changed:2ff93784-b640-46c6-b8f6-cf8b1abac5f5 for instance e034f877-4abe-4014-8097-62fd05e67978 on hv-cinder-86188 Oct 19 13:44:57.855187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-78615265-ddcc-4a01-8ff2-fce19912de2a req-9ab06d29-cb70-475d-91b7-81d6dbabab67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038016 Oct 19 13:44:57.861807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 469/946] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:45:16.480434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:16.481367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=29 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:16.678146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-70f3a933-20da-4cbe-b521-4dcf607bc1ee tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Action: 'create', calling method: .version_select at 0x7fb41e3d8160>, body: {"keypair": {"name": "tempest-TestShelveInstance-500723674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr67iqBmMZYttPMqSzsNZ3CLqRPtB4OiwNUz6X9/8lY+0gbr75PE0dMCYtyR1+vOR6jASUQDJMpb0qADIprRDdynuIqeB4qaSaURCdUj5ITpvd/VqGzXP/aVRIk/lpnQA=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:45:16.694739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-70f3a933-20da-4cbe-b521-4dcf607bc1ee tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Getting quotas for project 76384f17c9384958983b188d3617be7e. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:45:16.698770 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-70f3a933-20da-4cbe-b521-4dcf607bc1ee tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Getting quotas for user 8f759f41b4d44a53a0b60443b4df0a75 and project 76384f17c9384958983b188d3617be7e. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:45:16.766533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-70f3a933-20da-4cbe-b521-4dcf607bc1ee tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307983 Oct 19 13:45:16.767217 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 478/947] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:45:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:45:35.136590 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:35.137274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:35.143562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:35.144048 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:35.144487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:35.145177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:35.145638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:35.146063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:35.169563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9c2f35f1-bdf1-4965-bc0a-99fa7d4bf5fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/ips" status: 200 len: 152 microversion: 2.20 time: 0.173556 Oct 19 13:45:35.170111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 470/948] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Oct 19 13:45:34 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/ips => generated 152 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:45:38.268552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:38.269226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:38.273237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:45:38.273772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:38.280634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:38.283128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:38.283128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:38.283128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:38.283128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:38.283506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:38.308283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lazy-loading 'flavor' on Instance uuid 0611abf1-ca29-40e8-bcc5-b1a715097546 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:45:38.756619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-08e91fd8-67c7-417c-a3ab-bdcc43b3ebcc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/action" status: 202 len: 0 microversion: 2.20 time: 0.489512 Oct 19 13:45:38.760190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 479/949] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 13:45:38 2022] POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:45:38.765877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:38.766492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:38.772665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:38.773139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:38.773605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:38.774291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:38.774769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:38.777509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:38.903498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:38.911439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:38.912866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:38.914530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d9f01dcb-a1e1-4517-81ae-1a0dc1fb85fc tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.153112 Oct 19 13:45:38.915087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 471/950] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:38 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:39.942231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:39.942951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:39.950475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:39.950975 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:39.951404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:39.952078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:39.952525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:39.952971 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:40.082560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:40.091107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:40.092555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:40.093716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-12059326-8993-4371-972d-7c9b489103bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.156299 Oct 19 13:45:40.094268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 480/951] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:39 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:41.118805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:41.119415 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:41.125930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:41.126401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:41.126862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:41.127540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:41.127989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:41.128407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:41.251875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:41.260452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:41.261813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:41.263025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-40d1f3f8-cb25-43c8-9cae-fb5708eed195 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.148164 Oct 19 13:45:41.263582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 472/952] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:41 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:42.288732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:42.289962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:42.296726 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:42.297431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:42.298000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:42.298314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:42.298802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:42.299227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:42.427299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:42.435268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:42.436697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:42.437836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-61c9172e-6f0a-4965-b5e1-06c57389fc5c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.153094 Oct 19 13:45:42.438392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 481/953] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:42 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:43.206455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-764750352", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-500723674", "security_groups": [{"name": "tempest-secgroup-smoke-382730329"}], "networks": [{"uuid": "8aa2b745-836e-49b8-8c69-1ab0070f6330"}], "block_device_mapping_v2": [{"uuid": "b2718fe9-46c1-422d-ba72-5a5392869b0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:45:43.321409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] validate_networks() for [('8aa2b745-836e-49b8-8c69-1ab0070f6330', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:45:43.464090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:43.464802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:43.471204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:43.471753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:43.472274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:43.473026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:43.473547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:43.473970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:43.600114 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:43.608426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:43.609867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:43.611052 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-312d7ce0-2f0d-49fd-a3f8-73ba4e7d92ad tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.151500 Oct 19 13:45:43.611611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 482/954] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:43 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:45:43.782106 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:45:43.782559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:45:43.783045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:45:43.783458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:45:43.783897 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:45:43.792915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:43.793398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:43.793865 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:43.794618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:43.795077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:43.795504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:43.812773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Getting quotas for project 76384f17c9384958983b188d3617be7e. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:45:43.816713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Getting quotas for user 8f759f41b4d44a53a0b60443b4df0a75 and project 76384f17c9384958983b188d3617be7e. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:45:43.873524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:45:43.875689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2718fe9-46c1-422d-ba72-5a5392869b0c',volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:45:44.323606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8790b633-3734-461c-a151-0139063bd4df tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.121009 Oct 19 13:45:44.325022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 473/955] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:45:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:45:44.335347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7891e78c-a765-4c61-815f-753c31a43fda tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:44.336139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7891e78c-a765-4c61-815f-753c31a43fda tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:44.388074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7891e78c-a765-4c61-815f-753c31a43fda tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:44.394972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7891e78c-a765-4c61-815f-753c31a43fda tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1087 microversion: 2.1 time: 0.063407 Oct 19 13:45:44.395577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 483/956] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:44 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:44.637689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:44.638303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:44.644344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:44.644826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:44.645290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:44.645973 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:44.646429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:44.646879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:44.771866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:44.780483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:44.781974 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:44.783157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-43cc9b01-5484-4004-bebc-98bebd18ac8e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.149871 Oct 19 13:45:44.783712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 474/957] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:44 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:45.419004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:45.419623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:45.426613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:45.428843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:45.428843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:45.428843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:45.428843 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:45.429200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:45.491365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:45.499782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-21413e6b-882e-43cd-bd96-dbbcf6aeb181 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1137 microversion: 2.1 time: 0.085742 Oct 19 13:45:45.500333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 484/958] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:45 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:45.808594 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:45.809210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:45.815644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:45.816138 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:45.816582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:45.817271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:45.817724 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:45.818155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:45.946380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:45.954794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:45.956282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:45.957429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a2ed4f1b-f098-4250-bbbc-4185bbb44e5b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.152859 Oct 19 13:45:45.957982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 475/959] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:45 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:46.522649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:46.523214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:46.530173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:46.530695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:46.531128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:46.531805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:46.532253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:46.532670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:46.593016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:46.600487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fc3465ae-0205-4ad6-b8f2-65f3240d1537 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1185 microversion: 2.1 time: 0.081779 Oct 19 13:45:46.601048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 485/960] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:46 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:46.983205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:46.983972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:46.990463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:46.990970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:46.991399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:46.992086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:46.992529 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:46.993562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:47.151692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:47.159857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:47.161326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:47.162495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f451c560-f7f9-4874-9f6d-1cc3e7f364a2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.183347 Oct 19 13:45:47.163077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 476/961] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:46 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:47.629889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:47.632381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:47.638273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:47.638781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:47.639223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:47.640042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:47.640449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:47.640868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:47.783603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:47.788059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-799aae3c-b0c9-4798-9835-1b95d17d0e80 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1270 microversion: 2.1 time: 0.161987 Oct 19 13:45:47.789080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 486/962] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:47 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:48.189695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:48.190246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:48.197512 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:48.198043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:48.198447 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:48.199162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:48.199618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:48.200042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:48.397039 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:48.405127 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:48.406576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:48.407726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-00df35db-a84b-4050-9962-7ca8b5212ac6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.222082 Oct 19 13:45:48.408327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 477/963] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:48 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:48.640854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:45:48.650061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:48.650553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:48.650986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:48.661894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] Creating event network-changed:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:45:48.667422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-14862392-0c37-46af-b50b-d68b2307ee2e req-973037f7-669e-4552-b1bf-225115bfc2cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085297 Oct 19 13:45:48.671987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 487/964] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:45:48.811154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:48.811794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:48.817662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:48.818139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:48.818614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:48.819300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:48.819754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:48.820173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:49.251665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:49.260852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8008a483-8632-4978-aa1a-9e37c9ffee97 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.453520 Oct 19 13:45:49.261426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 478/965] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:48 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:49.434603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:49.435299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:49.441455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:49.441920 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:49.442353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:49.443066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:49.443517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:49.443935 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:49.573897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:49.582075 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:49.583542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:49.584680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-93031047-c0aa-472c-a320-d16c60c6f1b0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.154468 Oct 19 13:45:49.585227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 488/966] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:49 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:50.284011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:50.284580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:50.291574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:50.292326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:50.292763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:50.293446 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:50.293903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:50.294325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:50.422783 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:50.430353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-920bfece-d797-4e48-9121-bff543867bed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.150328 Oct 19 13:45:50.430946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 479/967] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:50 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:50.610283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:50.610958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:50.616913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:50.617396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:50.617837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:50.618540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:50.619000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:50.619426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:50.744263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:50.752250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:50.753687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:50.754859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-63af5abc-9e29-4e12-9065-93197c8102ec tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.148597 Oct 19 13:45:50.755409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 489/968] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:50 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:51.452821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:51.453435 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:51.459965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:51.460453 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:51.460895 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:51.461585 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:51.462045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:51.462473 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:51.590145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:51.597691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9ca7ede3-5152-4497-915f-1b3140de0256 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.148779 Oct 19 13:45:51.599135 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 480/969] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:51 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:51.780812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:51.781421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:51.787830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:51.788253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:51.788687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:51.789370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:51.790381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:51.790849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:51.914156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:51.922982 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:51.924419 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:51.925564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-64d29b1e-a9cd-4bbe-b7f9-05f525803715 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.148616 Oct 19 13:45:51.926118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 490/970] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:51 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:52.621462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:52.622007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:52.628462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:52.628935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:52.629365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:52.630041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:52.630489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:52.630934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:52.761667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:52.769252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a4ffdbc1-0589-4b80-8940-448b158a65f0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.152406 Oct 19 13:45:52.769805 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 481/971] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:52 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:52.950702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:52.951242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:52.957685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:52.958170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:52.958646 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:52.959336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:52.959790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:52.960214 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:53.316470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:53.324407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:53.325827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:53.326998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-55876b3c-f122-4143-abc4-9f5213f0a647 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.380269 Oct 19 13:45:53.327546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 491/972] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:52 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:53.791152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:53.792020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:53.798454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:53.798969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:53.799409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:53.800128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:53.800583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:53.801008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:53.803669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:53.825143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:53.930401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:53.938290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f69bb521-46e1-46da-92b6-fe699dd4207e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.151064 Oct 19 13:45:53.938883 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 482/973] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:53 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:54.352755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:54.353366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:54.359801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:54.360321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:54.360759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:54.361445 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:54.361900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:54.362319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:54.392460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:54.488966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:54.497535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:54.499035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:54.500170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-947738b6-47e5-4659-bfc6-4b61df1117bd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.151526 Oct 19 13:45:54.500727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 492/974] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:54 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:54.961760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:54.962308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:54.968669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:54.969141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:54.969568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:54.970248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:54.970735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:54.971157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:55.099735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:55.108023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dced1437-97f6-4697-b0a6-fcc810546ceb tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.150700 Oct 19 13:45:55.108618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 483/975] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:54 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:55.526101 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:55.526702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:55.533098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:55.533586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:55.534027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:55.534749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:55.535206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:55.535636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:55.668912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:55.677202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:55.678699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:55.680382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-556f657a-5d6c-482a-a2fd-1ad03fcbb46d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.158486 Oct 19 13:45:55.681176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 493/976] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:55 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:56.130892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:56.131438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:56.138325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:56.138848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:56.139284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:56.139968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:56.140423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:56.140844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:56.271842 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:56.280365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5ffd62b8-12c5-4843-90f5-98aff1ebd51a tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.153377 Oct 19 13:45:56.280991 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 484/977] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:56 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:56.705786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:56.706384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:56.712837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:56.713398 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:56.713826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:56.714531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:56.714961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:56.715377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:56.840856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:56.848826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:56.850264 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:56.851437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2fd22e49-4b9f-4367-95be-c403c7def387 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.149516 Oct 19 13:45:56.852480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 494/978] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:56 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:57.303380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:57.304021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:57.310526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:57.311006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:57.311439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:57.312121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:57.312572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:57.312996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:57.440876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:57.449028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fd3f9e24-9ce3-4fa0-8622-3420d62fd4e0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.149585 Oct 19 13:45:57.449585 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 485/979] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:57 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:57.878232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:57.878873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:57.886014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:57.886534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:57.886972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:57.887671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:57.888186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:57.888619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:57.892705 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:58.020157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:58.028738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:58.034434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:58.034434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7e72641c-8256-4184-bbae-c4badb50fd2f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.157010 Oct 19 13:45:58.034434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 495/980] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:57 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:58.472003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:58.472615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:58.479451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:58.479931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:58.480359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:58.481041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:58.481489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:58.481916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:58.615840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:58.623464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9eee8173-e7f2-41c3-9123-be818883858f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.155338 Oct 19 13:45:58.624024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 486/981] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:58 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:45:59.056611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:59.057354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:59.063972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:59.064457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:59.064892 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:59.065577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:59.066028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:59.066451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:59.191066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:59.199616 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:59.201086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:59.203332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-79ecde4a-ecd1-4a8e-88d2-9ecf4adb6a05 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.149996 Oct 19 13:45:59.203332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 496/982] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:45:59 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:45:59.646079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:59.646732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:59.654751 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:59.655241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:59.655915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:59.656618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:59.657084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:59.657592 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:59.673807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:59.789662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:45:59.797596 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-19a41c57-8b8d-420a-af02-ef5412e4c2b4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.155321 Oct 19 13:45:59.798153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 487/983] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:45:59 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:00.228258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:00.228832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:00.234959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:00.235443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:00.235878 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:00.236557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:00.237010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:00.237431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:00.365403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:00.373845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:00.375312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:00.376484 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0308634a-d5f0-4a13-a808-50706971407d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.152345 Oct 19 13:46:00.377056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 497/984] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:00 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:00.820496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:00.821141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:00.827442 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:00.827947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:00.828379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:00.829059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:00.829510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:00.829929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:00.956170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:00.964335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5be3e625-beec-41a7-b5b3-3351106f8ed5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.147771 Oct 19 13:46:00.964905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 488/985] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:00 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:01.402907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:01.403511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:01.409909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:01.410381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:01.410847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:01.411519 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:01.411966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:01.412390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:01.535801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:01.543940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:01.545481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:01.546636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-eefe3504-ef49-43f9-9591-38556752c8bb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.148207 Oct 19 13:46:01.547186 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 498/986] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:01 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:01.986574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:01.987184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:01.994167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:01.994674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:01.995104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:01.995781 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:01.996227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:01.996646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:02.129128 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:02.136706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-22f9d6b0-eea2-4ae7-9b25-546a5b8c0c0b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.154044 Oct 19 13:46:02.137262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 489/987] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:01 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:02.572390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:02.572955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:02.579280 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:02.579761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:02.580193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:02.580966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:02.581420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:02.581837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:02.643429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "name": "network-vif-plugged", "status": "completed", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:02.653531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:02.656400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:02.656400 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:02.665715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] Creating event network-vif-plugged:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:46:02.672156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-66e6b605-afd8-48cb-8153-3fe586552bbb req-149d8caa-7921-49d4-b5ca-e1c2ef325e74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089175 Oct 19 13:46:02.673115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 490/988] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:02.715767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:02.724011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:02.725454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:02.726643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-44ca3fe4-77f9-49f8-9e0f-a49e408d88f4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.158258 Oct 19 13:46:02.727210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 499/989] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:02 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:03.160114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:03.160765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:03.167148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:03.167633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:03.168074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:03.168761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:03.169220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:03.169652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:03.297567 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:03.305854 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e8d805b3-3757-4255-8f75-5dc4f93e0bbe tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.150555 Oct 19 13:46:03.306411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 491/990] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:03 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:03.751317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:03.751923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:03.758244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:03.758757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:03.759190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:03.759867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:03.760314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:03.760737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:03.889309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:03.897273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:03.899292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:03.900426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a5075311-b986-4241-ba3f-487b4031e6d9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1745 microversion: 2.20 time: 0.153019 Oct 19 13:46:03.900978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 500/991] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:03 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:04.328622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:04.329231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:04.335740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:04.336865 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:04.337311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:04.337978 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:04.338431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:04.338881 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:04.472175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:04.480365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9160067f-3624-4028-a1c2-d19ebdf7f8b5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.155532 Oct 19 13:46:04.480929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 492/992] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:04 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:04.688027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "name": "network-vif-plugged", "status": "completed", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:04.697905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:04.698384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:04.698852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:04.709677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] Creating event network-vif-plugged:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:46:04.714648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-203a1cec-148d-483a-a64a-49f232dc138f req-e2e9f4ca-cef0-480c-a1f2-f5392822c973 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Oct 19 13:46:04.715247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 501/993] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:04.926802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:04.927536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:04.934280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:04.934795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:04.935372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:04.936076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:04.936532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:04.936960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:05.076137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:05.085334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:05.089578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:05.091471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5edddd17-ae66-4f9d-9edb-9f57633d81ae tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.168555 Oct 19 13:46:05.093351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 493/994] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:04 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:05.506182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:05.506913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:05.513422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:05.513906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:05.514346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:05.515055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:05.515500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:05.515915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:05.653376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:05.661591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-633b7f9a-20f8-4319-91fc-9966fbfeba19 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.160553 Oct 19 13:46:05.662385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 502/995] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:05 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:06.124040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:06.124670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:06.127427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:06.132492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:06.133353 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:06.133892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:06.135426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:06.135960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:06.136465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:06.292536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:06.303319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:06.305750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:06.306961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-879b3d49-40d0-4eba-bf94-525808d00410 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.186962 Oct 19 13:46:06.313313 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 494/996] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:06 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:06.688457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:06.689360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:06.697531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:06.698157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:06.698807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:06.699592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:06.700054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:06.700485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:06.840692 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:06.849108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f49f536c-2027-4392-85ba-daeb5c86f66c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1258 microversion: 2.1 time: 0.164579 Oct 19 13:46:06.849868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 503/997] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:06 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:07.333613 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:07.334486 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:07.341105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:07.341671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:07.342255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:07.343071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:07.343838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:07.344507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:07.497185 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:07.509013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:07.510267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:07.511961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dce462ae-626e-4b24-85f5-46efe15a22a4 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.182172 Oct 19 13:46:07.513497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 495/998] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:07 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:07.872132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:07.873378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:07.879887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:07.880374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:07.880813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:07.881529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:07.881983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:07.882408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:08.030261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:08.039859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-08666ce1-48f1-49eb-9d23-dd8e9f2a81a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1443 microversion: 2.1 time: 0.171425 Oct 19 13:46:08.041227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 504/999] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:07 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1443 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:08.065606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:08.066322 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:08.073159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:08.073655 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:08.074550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:08.075063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:08.075470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:08.075928 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:08.225880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:08.235025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ec3de8ab-9b9c-4922-bcc1-fa5973fb01b1 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1443 microversion: 2.1 time: 0.173362 Oct 19 13:46:08.235619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 496/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:08 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:08.542730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:08.543257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:08.545400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=55 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:08.550001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:08.550478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:08.550937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:08.551611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:08.552058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:08.552477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:08.681142 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:08.689573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:08.691225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:08.692470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3fff2bcd-0e13-4a58-831f-7da5fd2f3e27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.154701 Oct 19 13:46:08.693058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 505/1001] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:08 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:09.720351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:09.721557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:09.730815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.733165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.733611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.734538 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.735166 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.735775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.909110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:09.919315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:09.920761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:09.921956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-96fd9d7e-4ae0-416f-994f-14653c5f031f tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.205570 Oct 19 13:46:09.922541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 497/1002] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:09 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:10.899709 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:10.914438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:10.915814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:10.916758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:10.931630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] Creating event network-changed:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:46:10.936994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-aa3f0e3a-3d15-4d84-9afc-8cbe6ed756c2 req-243660e4-c8eb-437d-baf0-9f8b91348d2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042628 Oct 19 13:46:10.937779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 506/1003] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:10.948996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:10.949626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:10.956622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:10.957315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:10.957753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:10.958460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:10.958936 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:10.959365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:11.579126 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:11.603367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:11.603638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:11.604880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7f0d56d0-5fe5-433b-9ac8-d350a204f247 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.660830 Oct 19 13:46:11.605862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 498/1004] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:10 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:12.633247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:12.634475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:12.641000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:12.641546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:12.641985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:12.642722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:12.643181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:12.643610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:12.783489 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:12.791902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:12.793338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:12.794496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dd7416d8-11bf-427d-87d7-ff6443713c61 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.166158 Oct 19 13:46:12.795072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 507/1005] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:12 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:13.820608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:13.821343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:13.828191 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.828675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.829115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.829808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.830273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.830736 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.973764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:13.982793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:13.984375 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:13.985612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9eab909b-7c2d-418b-8e82-60b982880eac tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.168926 Oct 19 13:46:13.986249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 499/1006] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:13 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:15.012328 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:15.014905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:15.022752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:15.023312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:15.023831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:15.024666 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:15.026573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:15.026573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:15.183453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:15.192897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:15.194321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:15.195559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-05eea1cd-1a93-428b-897d-c4b1de8135c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.187398 Oct 19 13:46:15.196493 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 508/1007] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:15 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:16.222652 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:16.223290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:16.230376 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:16.230889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:16.231326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:16.232010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:16.232462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:16.232935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:16.364908 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:16.373602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:16.375068 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:16.376216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6dca5079-b348-410b-84a0-53ef66c41443 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.157812 Oct 19 13:46:16.376770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 500/1008] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:16 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:17.401853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:17.403177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:17.409499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:17.409976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:17.410409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:17.411127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:17.411575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:17.411997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:17.544421 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:17.553014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:17.554456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:17.555628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8390eeeb-1e1f-42e7-ab86-146fbf225d98 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1740 microversion: 2.20 time: 0.158408 Oct 19 13:46:17.556438 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 509/1009] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:17 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:18.580828 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:18.581505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:18.588255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:18.588741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:18.589174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:18.589857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:18.590309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:18.590766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:18.729657 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:18.737586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:18.739038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:18.740250 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-68baf432-5d23-4320-ad7e-238324477ca8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1722 microversion: 2.20 time: 0.163566 Oct 19 13:46:18.740810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 501/1010] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:18 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:19.766473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:19.767104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:19.773546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:19.774026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:19.774460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:19.775163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:19.775615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:19.776036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:19.900615 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:19.908627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:19.910073 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:19.911287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3c9afe79-3021-4890-bca7-719b8569136d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1722 microversion: 2.20 time: 0.148727 Oct 19 13:46:19.911854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 510/1011] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:19 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:20.937173 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:20.937767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:20.944475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:20.944953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:20.945380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:20.946060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:20.946525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:20.946954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:21.077335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:21.086181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:21.087783 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:21.088981 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1d03de70-aea1-46f3-be8d-b6bb5827a6fa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1722 microversion: 2.20 time: 0.155737 Oct 19 13:46:21.090063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 502/1012] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:20 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:22.115926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:22.116533 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:22.123368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:22.123904 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:22.124334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:22.125016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:22.125471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:22.125998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:22.253406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:22.261433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:22.262823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:22.263958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f471e639-59c1-4661-bbca-042e775ace0d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1665 microversion: 2.20 time: 0.152186 Oct 19 13:46:22.264508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 511/1013] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:22 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:22.288099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94c15cb3-b168-4d12-85e7-53c91ece427f"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:22.290530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:22.297520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:22.297994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:22.298426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:22.299137 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:22.299585 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:22.300007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:22.582527 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "name": "network-vif-unplugged", "status": "completed", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:22.592340 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:22.592813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:22.593237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:22.604000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.compute.server_external_events [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] Unable to find a host for instance 0611abf1-ca29-40e8-bcc5-b1a715097546. Dropping event network-vif-unplugged {{(pid=125748) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 13:46:22.605488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-0c36500c-ef42-41dd-a02c-ad1902b912b0 req-9f19c094-09b8-4fda-a6fd-0b18410dc9f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027852 Oct 19 13:46:22.605992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 512/1014] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 13:46:22.747305 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:23.216530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-13ac1f06-fa42-4599-ae4d-ce14246ac0c9 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.932261 Oct 19 13:46:23.217063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 503/1015] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Oct 19 13:46:22 2022] POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments => generated 188 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:46:23.342251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:23.342817 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:23.349098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:23.349570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:23.349997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:23.350712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:23.351160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:23.351578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:23.425301 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=100 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:23.899428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d0441dc2-489d-4e78-89c2-368d095b2ecb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments/94c15cb3-b168-4d12-85e7-53c91ece427f" status: 202 len: 0 microversion: 2.20 time: 0.560963 Oct 19 13:46:23.899939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 513/1016] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Oct 19 13:46:23 2022] DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments/94c15cb3-b168-4d12-85e7-53c91ece427f => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:46:23.969747 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:23.970347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:23.976811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:23.977291 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:23.977726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:23.978406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:23.978888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:23.979312 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:24.022451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125749) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 13:46:24.300210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aa0385d8-0271-44c1-ac5b-54505a88e840 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/action" status: 202 len: 0 microversion: 2.20 time: 0.334528 Oct 19 13:46:24.301024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 504/1017] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Oct 19 13:46:23 2022] POST /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:46:24.310177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:24.311080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:24.319006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:24.319686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:24.320118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:24.320811 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:24.321260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:24.321680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:24.451803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:24.460066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:24.461497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:24.462657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-933fb685-edb4-4f79-b130-0f35304a29e6 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1673 microversion: 2.20 time: 0.157516 Oct 19 13:46:24.463196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 514/1018] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:24 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:25.489533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:25.490274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:25.496341 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:25.496845 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:25.497251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:25.497931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:25.498382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:25.498831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:25.629468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:25.637509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:25.638965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:25.640145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8e915354-3a26-403a-acb5-8755ed68d61c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1673 microversion: 2.20 time: 0.155078 Oct 19 13:46:25.640702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 505/1019] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:25 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:26.665203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:26.666065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:26.673656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:26.674137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:26.674592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:26.675274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:26.675719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:26.676133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:26.807177 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:26.816147 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:26.817608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:26.818831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9fb5be02-121a-4b1d-bb41-eb31cf8a0ca3 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.157466 Oct 19 13:46:26.819397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 515/1020] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:26 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:27.847280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:27.848710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:27.861934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:27.862418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:27.862876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:27.863578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:27.864209 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:27.865070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:28.027150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:28.036262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:28.040311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:28.042840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7fc3da21-c902-4f2a-a857-e810ca70c573 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.201338 Oct 19 13:46:28.043679 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 506/1021] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:27 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:29.073006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:29.074120 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:29.080884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:29.081376 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:29.081812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:29.082521 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:29.083001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:29.083426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:29.223330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:29.232382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:29.233919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:29.235219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fe888a90-301a-4fe9-a0f5-c262f380c578 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.166108 Oct 19 13:46:29.235859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 516/1022] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:29 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:30.261242 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:30.261988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:30.268438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:30.268927 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:30.269360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:30.270058 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:30.270793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:30.271393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:30.408396 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:30.417252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:30.419231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:30.420642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-45549a6c-40d9-4fdc-9cd4-37a40017b6e5 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.163342 Oct 19 13:46:30.421210 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 507/1023] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:30 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:31.445424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:31.446039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:31.453368 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:31.453861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:31.454302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:31.455105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:31.455565 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:31.455995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:31.591458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:31.600586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:31.602061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:31.603254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1163a98e-aeb3-4c66-b6f6-b63ce829d449 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.161754 Oct 19 13:46:31.604279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 517/1024] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:31 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:32.629931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:32.630478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:32.637963 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:32.638456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:32.638915 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:32.639623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:32.640074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:32.640510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:32.774122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:32.782985 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:32.784419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:32.785614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0c40c23d-c69a-4827-bc9c-e4749f96f597 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.160001 Oct 19 13:46:32.786193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 508/1025] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:32 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:33.811601 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:33.812463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:33.820012 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:33.820628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:33.821071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:33.821932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:33.822699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:33.823439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:33.963078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:33.972094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:33.974308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:33.975649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c94b6592-b755-4fba-a2a0-26dcb55bf712 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.168204 Oct 19 13:46:33.976476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 518/1026] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:33 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:35.003644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:35.004313 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:35.011586 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:35.012068 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:35.012498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:35.013219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:35.013890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:35.014314 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:35.155429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:35.164471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:35.166392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:35.167587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3e97f3f5-bafb-4053-a7ac-842dcadd954c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.168419 Oct 19 13:46:35.171956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 509/1027] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:34 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:36.195067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:36.195649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:36.208058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:36.208664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:36.209175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:36.209959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:36.210668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:36.211245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:36.356505 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:36.364918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:36.366431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:36.368556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0f9f6f1e-da4f-4caa-89fd-b590b9df1fc2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.177118 Oct 19 13:46:36.368556 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 519/1028] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:36 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:36.800024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:36.800595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:36.802845 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:36.807558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:36.808042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:36.808477 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:36.809169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:36.809625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:36.810052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:36.834498 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-de049b57-9ff2-4c4a-b073-d03d1c8188d0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/ips" status: 200 len: 146 microversion: 2.1 time: 0.038311 Oct 19 13:46:36.835076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 510/1029] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:46:36 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:37.393730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:37.394334 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:37.400805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:37.401276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:37.401702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:37.402374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:37.402844 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:37.403260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:37.529047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:37.536947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:37.538369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:37.539671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8119b313-f3a8-4c9e-91ca-4979c254c37e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.149710 Oct 19 13:46:37.540079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 520/1030] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:37 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:38.565616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:38.566228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:38.572876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:38.573356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:38.573792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:38.574992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:38.575443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:38.575917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:38.705723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:38.713794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:38.715916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:38.717068 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-deac577b-5f48-478a-a9ae-43a4f179334b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.155850 Oct 19 13:46:38.717623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 511/1031] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:38 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:39.741994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:39.742752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:39.749358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:39.749781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:39.750209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:39.750917 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:39.751363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:39.752888 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:39.885193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:39.893845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:39.895331 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:39.896467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1b07204b-6965-4f3a-a0f8-88d15efbca91 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.158384 Oct 19 13:46:39.897018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 521/1032] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:39 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:40.330704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf9d0473-79b1-42ad-81d3-91b05aeb9b53"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:40.333122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:40.339707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:40.340184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:40.340611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:40.341875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:40.342325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:40.342770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:40.921433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:40.922071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:40.924449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=34 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:40.929197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:40.929675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:40.930105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:40.930819 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:40.935494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:40.935494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:41.057802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:41.066058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:41.067526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:41.068704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e5a2bd63-1a1e-4a23-bea2-06544cccef92 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.151135 Oct 19 13:46:41.069257 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 522/1033] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:40 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:42.094523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:42.095151 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:42.101454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:42.101933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:42.102371 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:42.103071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:42.103515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:42.103929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:42.230913 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:42.239388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:42.240829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:42.241972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c33f77e8-a3ff-4de7-ae1f-3cb8f5c27474 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.151372 Oct 19 13:46:42.242540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 523/1034] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:42 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:43.268239 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:43.268879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:43.275188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:43.275663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:43.276090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:43.276924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:43.277379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:43.277798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:43.381122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6025816d-d228-4020-9cc2-2caad27a7cf5 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.054214 Oct 19 13:46:43.382225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 512/1035] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:46:40 2022] POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments => generated 194 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:43.406173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:43.414540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:43.416321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:43.417475 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-07a08b0e-d0d5-49b8-98cb-f2ac5c8e4a19 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.153231 Oct 19 13:46:43.418047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 524/1036] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:43 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:46:44.449461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:44.450402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:44.456752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:44.457229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:44.457667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:44.458356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:44.458840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:44.459263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:44.590589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:44.599429 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:44.605859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:44.605859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8ad9e9a7-0a65-432f-8b1f-9fa0b5bea0ee tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.156873 Oct 19 13:46:44.605859 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 513/1037] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:44 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:45.628668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:45.629270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:45.635672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:45.636152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:45.636765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:45.637466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:45.637919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:45.638345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:45.766925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:45.774952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:45.776429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:45.777645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cc1018fe-40ee-4bac-a51e-ead888023bdb tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.152957 Oct 19 13:46:45.778823 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 525/1038] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:45 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:46.804406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:46.805051 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:46.811977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:46.812460 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:46.812892 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:46.813576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:46.814028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:46.814448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:46.868822 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "name": "network-vif-plugged", "status": "completed", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:46.880891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:46.881363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:46.881792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:46.892978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] Creating event network-vif-plugged:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:46:46.898928 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-3f15506b-57d3-4c50-a7be-0fbd4a6841a8 req-7a5d6977-3116-4d49-a04b-f75fc761e229 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 Oct 19 13:46:46.902529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 526/1039] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:46:46.942703 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:46.953090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:46.954569 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:46.955987 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e4a1a212-2bb2-42eb-a0f9-bdd8b793bd1a tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.155869 Oct 19 13:46:46.956551 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 514/1040] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:46 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:47.981937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:47.982593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:47.989279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:47.989794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:47.990225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:47.990941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:47.991399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:47.991824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:48.118134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:48.126735 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:48.128181 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:48.129329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3d6e466d-ef46-452d-97d2-63e29095a5c2 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.151701 Oct 19 13:46:48.129889 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 527/1041] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:47 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:49.155935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:49.156541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:49.163285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:49.163765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:49.164197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:49.164876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:49.165594 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:49.166011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:49.297834 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:49.305839 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:49.307307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:49.308489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b10cba3c-1d2f-4eab-a0c2-45cd58f273c8 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.156985 Oct 19 13:46:49.309157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 515/1042] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:49 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:50.333685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:50.334291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:50.341277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:50.341756 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:50.342185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:50.342899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:50.343345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:50.343765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:50.471178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:50.473446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:50.479805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:50.483191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:50.483191 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-77262377-7c8f-4667-8fd5-1c845f4342e0 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1731 microversion: 2.20 time: 0.153384 Oct 19 13:46:50.483655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 528/1043] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:50 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:51.507228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:51.507838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:51.514225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:51.514740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:51.515179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:51.515864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:51.516321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:51.516748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:51.644032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:51.646368 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:51.652812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:51.654817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:51.656056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2a1f72ca-e8d8-4d73-905e-2933166ef9be tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1718 microversion: 2.20 time: 0.152731 Oct 19 13:46:51.656606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 516/1044] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:46:51 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:46:51.978380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:51.985508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:51.985978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:51.986402 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:52.047905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Going to try to stop instance {{(pid=125748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 13:46:52.251042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1c1cd48c-7688-478a-b518-f02c94f69f40 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action" status: 202 len: 0 microversion: 2.1 time: 0.276504 Oct 19 13:46:52.251586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 529/1045] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:46:51 2022] POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:46:52.259591 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:52.260206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:52.267332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:52.267813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:52.268253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:52.268942 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:52.269398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:52.269825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:52.401083 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:52.409636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-53f833d7-d3c9-415e-a668-abcc9f760f0a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.153933 Oct 19 13:46:52.410195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 517/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:52 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:53.434678 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:53.435378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:53.441516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:53.441990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:53.442426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:53.443129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:53.443584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:53.444009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:53.573764 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:53.581933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ac75b98c-4be6-4259-86e9-aa5982b49744 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.152459 Oct 19 13:46:53.582494 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 530/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:53 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:54.604880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:54.605431 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:54.612176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:54.613820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:54.613820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:54.613820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:54.614172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:54.614624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:54.739954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:54.748597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ee64798f-669c-4b49-99b7-c4fe3605997a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.147740 Oct 19 13:46:54.749192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 518/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:54 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:55.772839 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:55.773448 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:55.780545 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:55.781046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:55.781479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:55.782165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:55.782908 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:55.783333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:55.910522 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:55.918877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b9f15267-01c8-45ae-ae3a-ee4f9fc9f286 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.149853 Oct 19 13:46:55.919441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 531/1049] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:55 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:56.942716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:56.943326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:56.949752 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:56.950235 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:56.950704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:56.951392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:56.951849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:56.952276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:57.080860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:57.088933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9c35bd05-1044-4fad-840e-f0fb1a08467e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.150132 Oct 19 13:46:57.089497 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 519/1050] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:56 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:58.113014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:58.113548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:58.120854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:58.121936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:58.122432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:58.123150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:58.123603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:58.124379 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:58.253175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:58.261561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-98a772ab-1a02-4634-b21f-6f1d8aa70899 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.152608 Oct 19 13:46:58.262125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 532/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:58 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:59.284029 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:59.284562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:59.291380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:59.291867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:59.292304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:59.292986 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:59.293440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:59.293862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:59.417304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:59.425520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-42613dc4-0d89-4ccd-9f4d-70d58e3286f7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.145531 Oct 19 13:46:59.426076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 520/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:59 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:00.448492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:00.449132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:00.456011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:00.456491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:00.456926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:00.457608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:00.458061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:00.458485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:00.585004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:00.593645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ad619666-485b-4727-967d-fc4343542a22 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.148930 Oct 19 13:47:00.594149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 533/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:00 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:01.616559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:01.617169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:01.623611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:01.624086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:01.624516 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:01.625195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:01.625646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:01.626069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:01.754114 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:01.762257 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2330ebcd-616f-484e-96a9-cd17eb6b591c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.149501 Oct 19 13:47:01.762851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 521/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:01 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:02.785284 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:02.785894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:02.792593 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:02.793076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:02.793504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:02.794209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:02.794689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:02.795111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:03.067668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:03.076403 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-950e652b-e902-46e6-ad1a-de136d121d68 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.294965 Oct 19 13:47:03.076965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 534/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:02 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:04.099390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:04.099994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:04.106299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:04.106819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:04.107253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:04.107932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:04.108378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:04.108796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:04.234180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:04.242455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1dc11ebe-cf34-473d-a71e-f8504f981446 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.147006 Oct 19 13:47:04.243035 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 522/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:04 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:05.265053 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:05.265656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:05.272074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:05.272546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:05.272973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:05.273641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:05.274084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:05.274496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:05.400381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:05.408848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2f9496c0-8485-43f7-a129-704b0c41d9a6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.147608 Oct 19 13:47:05.409397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 535/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:05 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:06.432764 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:06.433375 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:06.439873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:06.440351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:06.440780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:06.441455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:06.441903 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:06.442321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:06.566786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:06.575387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c83294aa-4475-4fda-8b07-2708ff49b041 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.146058 Oct 19 13:47:06.582343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 523/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:06 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:07.599187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:07.599791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:07.606835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:07.611060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:07.611060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:07.611060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:07.611060 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:07.611437 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:07.733970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:07.742347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-72c49e45-82b1-49b8-8cf3-7439e5d97c23 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.147007 Oct 19 13:47:07.742939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 536/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:07 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:08.765818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:08.766405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:08.768699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=28 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:08.773304 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:08.773787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:08.774218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:08.774930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:08.775381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:08.775800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:08.906406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:08.914812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-06df080c-e062-4128-9afc-b50977cf2d1f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.152735 Oct 19 13:47:08.915377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 524/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:08 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:09.939293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:09.939911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:09.946426 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:09.946951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:09.947390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:09.948079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:09.948564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:09.948987 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:10.087729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:10.095841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0534a15c-fb07-4579-84df-bf6381c87d6a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.160423 Oct 19 13:47:10.096404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 537/1061] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:09 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:11.119326 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:11.119948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:11.127136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:11.127617 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:11.128050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:11.128743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:11.129197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:11.129618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:11.256906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:11.266193 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f3b40cc7-3c1e-45c8-9ce5-0040f6c5ac55 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.150677 Oct 19 13:47:11.266798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 525/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:11 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:11.279955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761297028", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-857404674", "security_groups": [{"name": "tempest-secgroup-smoke-2085292027"}], "block_device_mapping_v2": [{"uuid": "76734432-3826-4b35-a23f-df0d6b1c05e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac"}]}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:47:11.290954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=32 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:11.391567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] validate_networks() for [('11d5725d-b4d2-4070-ab4c-e9a9dac0b2ac', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:47:11.802129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:47:11.802582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:47:11.803098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:47:11.803456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:47:11.803862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:47:11.813264 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:11.817968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:11.817968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:11.817968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:11.817968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:11.818353 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:11.831923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:47:11.835782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Getting quotas for user e7a6ae7333d2422ebc9f616d482e527a and project 7a1c12d9a4454de59ed63d3cedb71a58. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:47:11.891281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:47:11.893451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76734432-3826-4b35-a23f-df0d6b1c05e2',volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:47:12.289776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:12.290390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:12.296827 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:12.297307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:12.297742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:12.298436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:12.298921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:12.299347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:12.341668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-89769ea7-a4d6-4e03-8920-872438732494 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065501 Oct 19 13:47:12.342704 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 538/1063] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:47:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:47:12.353685 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2e4f624f-e364-4051-b51c-b8be64026f59 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:12.354296 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2e4f624f-e364-4051-b51c-b8be64026f59 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:12.409955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2e4f624f-e364-4051-b51c-b8be64026f59 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:12.418023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2e4f624f-e364-4051-b51c-b8be64026f59 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1094 microversion: 2.1 time: 0.068057 Oct 19 13:47:12.418862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 539/1064] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:12 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:47:12.448770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:12.457625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4854d14c-e92c-452f-837e-43e67840e749 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1724 microversion: 2.1 time: 0.172015 Oct 19 13:47:12.458188 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 526/1065] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:12 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:47:13.440375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:13.441169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:13.447637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.448119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.448553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.449235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.449686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.450110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.480570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:13.481754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:13.488174 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.488662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.489098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.489787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.490240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.490709 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.516989 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:13.530534 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-08de4235-e07d-41a9-b53e-8bda194c161f tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1144 microversion: 2.1 time: 0.093896 Oct 19 13:47:13.531354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 540/1066] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:13 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:13.625185 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:13.633733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-74a4c1a7-291c-4b65-b73c-b54877de0ffb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1701 microversion: 2.1 time: 0.157044 Oct 19 13:47:13.634349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 527/1067] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:13 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:47:13.658081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:47:13.663968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.664706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.665137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.687244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Going to try to start instance {{(pid=125748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 13:47:13.868028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-39ce4135-5b15-4d73-877d-dc9d02b2c2d8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action" status: 202 len: 0 microversion: 2.1 time: 0.213255 Oct 19 13:47:13.869072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 541/1068] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:47:13 2022] POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:47:13.877298 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:13.878141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:13.883967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.884443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.884874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:13.885556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:13.886003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:13.886424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:14.015248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:14.024091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-50fd4734-2dab-4a88-897a-3acb2923f275 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1710 microversion: 2.1 time: 0.150630 Oct 19 13:47:14.024790 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 528/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:13 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:14.553741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:14.554432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:14.561926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:14.562400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:14.562852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:14.563537 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:14.563980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:14.564395 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:14.626332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:14.634366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f2d7d245-d5e6-44ef-8ba7-e22dbabc8180 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1200 microversion: 2.1 time: 0.084873 Oct 19 13:47:14.634972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 542/1070] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:14 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:15.051556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:15.053073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:15.057211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:47:15.057413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Wed Oct 19 13:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d (ip 10.222.0.39) !!! Oct 19 13:47:15.062057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:15.062667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:15.063107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:15.064092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:15.064555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:15.065016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:15.280390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:15.289765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-15a21b0b-4f1b-44bb-91ba-b7082f6f1bcf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1710 microversion: 2.1 time: 0.243149 Oct 19 13:47:15.290345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 529/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:15 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:15.665374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:15.665374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:15.674560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:15.675041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:15.675478 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:15.676493 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:15.677011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:15.677449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:15.817762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:15.826367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4468576c-193a-4623-b94d-98e409342825 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1278 microversion: 2.1 time: 0.168823 Oct 19 13:47:15.831746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 543/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:15 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:16.313080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:16.313697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:16.320091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:16.320572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:16.321008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:16.321715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:16.322171 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:16.322637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:16.505684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:16.513997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fc9a9db6-d752-45ea-9425-9552b94694c7 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1710 microversion: 2.1 time: 0.205499 Oct 19 13:47:16.514589 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 530/1073] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:16 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:16.849467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:16.850768 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:16.857144 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:16.864463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:16.864463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:16.864463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:16.864463 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:16.864899 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:17.027308 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:17.035941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-18f5c70a-f4eb-4c45-86e9-e18da9e81315 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1278 microversion: 2.1 time: 0.190487 Oct 19 13:47:17.046547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 544/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:16 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:17.483916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe843cdb-f631-48b9-87ff-607cb65ea223", "tag": "c348fc2c-dac2-47f2-a88e-cfb3454fc242"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:47:17.494109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:17.494608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:17.495038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:17.506698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] Creating event network-changed:c348fc2c-dac2-47f2-a88e-cfb3454fc242 for instance fe843cdb-f631-48b9-87ff-607cb65ea223 on hv-cinder-86188 Oct 19 13:47:17.511660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-643a02d4-c8a1-487d-975d-c92346ee3f37 req-88c38534-9adf-4127-8429-e0a6f6027513 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 Oct 19 13:47:17.512247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 531/1075] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:47:17.538139 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:17.538782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:17.545400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:17.545876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:17.546313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:17.547033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:17.547487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:17.551206 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:17.551882 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:17.676374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:17.685172 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d1b7b483-495a-41a6-b31a-1889d603a9bb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1714 microversion: 2.1 time: 0.151031 Oct 19 13:47:17.685734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 545/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:17 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:18.059062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:18.059771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:18.066063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:18.066595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:18.067043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:18.067738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:18.068201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:18.068775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:18.269016 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:18.276655 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-22c8ad74-2c87-4fd2-bb3c-906dd9d6e5ee tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.222064 Oct 19 13:47:18.277804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 532/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:18 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:19.300361 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:19.300973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:19.308028 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:19.309121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:19.309558 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:19.310240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:19.310722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:19.311146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:19.438644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:19.446176 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f2df2673-41fb-4c75-bf1b-c4b2a52eb081 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.150076 Oct 19 13:47:19.446766 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 546/1078] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:19 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:20.468145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:20.468826 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:20.475348 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:20.475837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:20.476278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:20.476967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:20.477425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:20.477856 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:20.603204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:20.618680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d3b2cf9c-b6eb-4e41-a1c1-ab698b5c1e9d tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.147072 Oct 19 13:47:20.618680 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 533/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:20 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:21.634322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:21.635926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:21.641921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:21.642429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:21.642894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:21.643577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:21.644031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:21.644454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:21.772819 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:21.780381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-52b02067-f20d-4876-9268-e26c0d81d604 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.150073 Oct 19 13:47:21.780944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 547/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:21 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:22.804445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:22.805074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:22.811777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:22.812255 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:22.812689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:22.813365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:22.813847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:22.814268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:22.818419 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=100 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:22.947956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:22.956537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-add359d6-697f-4d62-9cc3-6987f3ce1080 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.155847 Oct 19 13:47:22.957104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 534/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:22 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:23.979543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:23.980150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:23.982683 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:23.983396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=8 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:47:23.988555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:23.989030 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:23.993267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:23.993267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:23.993267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:23.993267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:24.120597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:24.128170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c1066380-89eb-411b-90f9-c411080c3d9e tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.152520 Oct 19 13:47:24.128725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 548/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:23 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:25.150938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:25.151572 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:25.157989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:25.158459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:25.158917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:25.159593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:25.160042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:25.160461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:25.285997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:25.294295 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-35040038-32ac-4a1e-8d96-a968b0c87ecd tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.146875 Oct 19 13:47:25.294885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 535/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:25 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:26.316733 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:26.317343 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:26.323763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:26.324242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:26.324677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:26.325956 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:26.326412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:26.326861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:26.454827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:26.462357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c1db18b9-579b-4d8e-92a9-c73b82fd37de tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.149457 Oct 19 13:47:26.462939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 549/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:26 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:27.485438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:27.486006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:27.492440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:27.492921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:27.493356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:27.494040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:27.494496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:27.494938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:27.627030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:27.634667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ffb647e9-764c-446e-ace1-3a91f369fede tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.153691 Oct 19 13:47:27.635231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 536/1085] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:27 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:28.663606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:28.664570 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:28.671523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:28.672004 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:28.672440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:28.673125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:28.673574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:28.673998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:28.800708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:28.808241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1411a3ba-780b-4fa0-9fb2-b9bd6d576f84 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.148474 Oct 19 13:47:28.808798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 550/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:28 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:29.371487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe843cdb-f631-48b9-87ff-607cb65ea223", "name": "network-vif-plugged", "status": "completed", "tag": "c348fc2c-dac2-47f2-a88e-cfb3454fc242"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:47:29.381528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:29.382002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:29.382434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:29.393483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] Creating event network-vif-plugged:c348fc2c-dac2-47f2-a88e-cfb3454fc242 for instance fe843cdb-f631-48b9-87ff-607cb65ea223 on hv-cinder-86188 Oct 19 13:47:29.398328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-df0007c8-89ec-4746-93d1-03a8c84670d4 req-4c89788b-4585-491e-9da8-2993502f2c91 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Oct 19 13:47:29.401168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 537/1087] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:47:29.831397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:29.832083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:29.838649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:29.839137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:29.839574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:29.840265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:29.840748 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:29.841178 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:29.975596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:29.984491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a304bc2c-6f3b-44b1-81f0-9d08af6c7706 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.157003 Oct 19 13:47:29.984988 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 551/1088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:29 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:31.008882 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:31.009587 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:31.016666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:31.017154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:31.017594 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:31.018284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:31.018767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:31.019195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:31.148057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:31.156520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b513c495-4a54-4e09-89be-8429938fb20b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.152421 Oct 19 13:47:31.165627 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 538/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:31 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:32.179551 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:32.180150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:32.186624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:32.187107 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:32.187542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:32.188258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:32.188710 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:32.189129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:32.316745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:32.324480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-33e41134-ccdf-4276-8900-8b715a217739 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1266 microversion: 2.1 time: 0.148870 Oct 19 13:47:32.325048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 552/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:32 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:33.347544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:33.348161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:33.354743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:33.355231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:33.355671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:33.356360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:33.356818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:33.357246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:33.487508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:33.495105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-afcf2e6e-3c3a-47c8-88f9-fc3126f4b341 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1453 microversion: 2.1 time: 0.151480 Oct 19 13:47:33.495664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 539/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:33 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:33.517465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:47:33.518071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:47:33.524361 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:33.524836 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:33.525266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:33.525940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:33.526391 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:33.526840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:33.653300 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:47:33.660931 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b71229fa-4c19-4fa5-ae85-9eaddcfea35b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1453 microversion: 2.1 time: 0.147222 Oct 19 13:47:33.661477 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 553/1092] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:47:33 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:47:35.732766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe843cdb-f631-48b9-87ff-607cb65ea223", "tag": "c348fc2c-dac2-47f2-a88e-cfb3454fc242"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:47:35.742201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:47:35.742917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:47:35.743430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:47:35.754329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] Creating event network-changed:c348fc2c-dac2-47f2-a88e-cfb3454fc242 for instance fe843cdb-f631-48b9-87ff-607cb65ea223 on hv-cinder-86188 Oct 19 13:47:35.759605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-70743cf3-0ce2-4f59-bca2-e12c4045a2b2 req-d7212303-9513-42b0-ae9a-ca4d3527698b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085950 Oct 19 13:47:35.760466 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 540/1093] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:48:08.440246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:08.442662 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:08.444867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:08.445501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=53 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:08.450129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:08.450642 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:08.451072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:08.451787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:08.452234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:08.452652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:08.482062 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5115f79b-6d19-485e-9154-98478574bffa tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045843 Oct 19 13:48:08.482632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 554/1094] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Oct 19 13:48:08 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:08.546731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:08.550095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:08.550095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=33 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:08.550308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=33 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:08.555194 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:08.555674 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:08.556113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:08.556802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:08.557261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:08.558309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:08.583015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:48:09.008503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-94139252-bf71-4ada-a121-d6539e375764 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 204 len: 0 microversion: 2.20 time: 0.466283 Oct 19 13:48:09.009087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 541/1095] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 13:48:08 2022] DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 13:48:09.017577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:09.018273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:09.025471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:09.025954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:09.026914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:09.027601 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:09.028054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:09.028509 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:09.157774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:09.166029 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:09.168084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:09.169235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-31b2a6d9-6b10-4e86-9a5b-8ae9d6534a27 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.155598 Oct 19 13:48:09.169785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 555/1096] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:09 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:48:10.195258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:10.195952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:10.202780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:10.203256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:10.203685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:10.204361 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:10.204815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:10.205232 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:10.336539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:10.345284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:10.346758 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:10.347947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c92f92cd-263f-4e88-ac7a-38936402a087 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.157220 Oct 19 13:48:10.348501 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 542/1097] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:10 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:48:11.373792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:11.374413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:11.380941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:11.381441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:11.381867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:11.382563 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:11.383011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:11.383429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:11.513040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:11.521118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:11.522585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:11.523752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-626776a9-36f6-4022-bd60-341a6f21e556 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1724 microversion: 2.20 time: 0.154420 Oct 19 13:48:11.524316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 556/1098] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:11 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:48:12.067109 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0611abf1-ca29-40e8-bcc5-b1a715097546", "name": "network-vif-deleted", "tag": "beb0c587-f873-4caf-bae2-953511ce5766"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:12.077750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:12.077750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:12.078057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:12.091997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] Creating event network-vif-deleted:beb0c587-f873-4caf-bae2-953511ce5766 for instance 0611abf1-ca29-40e8-bcc5-b1a715097546 on hv-cinder-86188 Oct 19 13:48:12.097098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-e1a4e1ac-59f0-4c4b-9142-1ce6e7a97101 req-239c3d97-5ce2-4585-9e82-b7826d32ccad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Oct 19 13:48:12.097759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 543/1099] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:48:12.549503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:12.550167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:12.556258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:12.556727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:12.557728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:12.558732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:12.559190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:12.559613 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:12.592160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:12.592640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:12.593071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:12.593508 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lazy-loading 'fault' on Instance uuid 0611abf1-ca29-40e8-bcc5-b1a715097546 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:48:12.637455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:12.646054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:12.647651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c828726ae814c0f879a5aa69f647a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8fa61ce6ff491b9d497db42d900f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:12.648896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c3ecadbd-aaf5-4f2f-9d66-b7afacbc677e tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 200 len: 1371 microversion: 2.20 time: 0.104104 Oct 19 13:48:12.649548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 557/1100] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:12 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:48:13.675450 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:13.676140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:13.682795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:13.683280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:13.683706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:13.684380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:13.684824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:13.685249 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:13.698254 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 HTTP/1.1 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:48:13.699891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:13.701388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '0611abf1-ca29-40e8-bcc5-b1a715097546'} Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:48:13.702299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:13.703925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:13.705479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:48:13.705479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ba278ad1-c996-4a9e-bb44-387136134acd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 404 len: 111 microversion: 2.20 time: 0.030458 Oct 19 13:48:13.705479 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 544/1101] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:13 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:48:13.709929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f4141298-a1ff-4140-ad01-e27495aaa473 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '.version_select at 0x7fb41e4268b0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:13.714457 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4141298-a1ff-4140-ad01-e27495aaa473 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [9dcdd224-855a-4504-9869-4103da45d112] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:48:14.723229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4141298-a1ff-4140-ad01-e27495aaa473 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [9dcdd224-855a-4504-9869-4103da45d112] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 39820. Oct 19 13:48:14.812697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f4141298-a1ff-4140-ad01-e27495aaa473 tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588467614" status: 204 len: 0 microversion: 2.20 time: 1.106504 Oct 19 13:48:14.813267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 558/1102] 10.222.0.39 () {60 vars in 1259 bytes} [Wed Oct 19 13:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588467614 => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 13:48:17.059511 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:17.060021 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:17.065872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:17.066355 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:17.066835 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:17.067523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:17.067988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:17.068423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:17.082056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 HTTP/1.1 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:48:17.083614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.085358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '0611abf1-ca29-40e8-bcc5-b1a715097546'} Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:48:17.086179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.087476 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.088841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:48:17.088841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bc13482e-a472-42ab-9bf3-20c168c3fafd tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 404 len: 111 microversion: 2.20 time: 0.030179 Oct 19 13:48:17.088841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 545/1103] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 13:48:17 2022] DELETE /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:48:17.094269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:17.094915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: 0611abf1-ca29-40e8-bcc5-b1a715097546] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:17.101416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:17.101895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:17.102330 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:17.103044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:17.103499 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:17.103959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:17.116815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 HTTP/1.1 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:48:17.118443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.120727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '0611abf1-ca29-40e8-bcc5-b1a715097546'} Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:48:17.121880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. Oct 19 13:48:17.123446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:17.124940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance 0611abf1-ca29-40e8-bcc5-b1a715097546 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:48:17.124940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-be84594a-fd1b-44e3-b456-454a55d4ee8d tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546" status: 404 len: 111 microversion: 2.20 time: 0.030550 Oct 19 13:48:17.124940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 559/1104] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:17 2022] GET /compute/v2.1/servers/0611abf1-ca29-40e8-bcc5-b1a715097546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:48:18.396010 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:18.396510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:18.403494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:18.403972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:18.404405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:18.405089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:18.405544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:18.405965 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:18.419309 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e HTTP/1.1 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:48:18.420838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.422494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'd15930e1-efde-41f3-a7b7-0da49230281e'} Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:48:18.423566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.425047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.426612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:48:18.426612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-577cbb0b-28eb-442a-9296-79eff282044b tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 404 len: 111 microversion: 2.20 time: 0.030119 Oct 19 13:48:18.426612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 546/1105] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Oct 19 13:48:18 2022] DELETE /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:48:18.430443 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:18.431080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] [instance: d15930e1-efde-41f3-a7b7-0da49230281e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:18.437480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:18.437949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:18.438381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:18.439100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:18.439581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:18.440002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:18.453602 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] HTTP exception thrown: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Request method failure captured: Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e HTTP/1.1 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_z5SDihRNf8Jpg2kce8tyH2NwFeooA_FW3kPOQGCMAWdXX4-MG89_EtsaXa_afCNDTYiEuUVZJ2C8AvU64N63PA0ahfP35j8bht56xkBxgNNUcA1aD6MAxZeB3fVEe9_GDI6cTcGMf-ON2VUcj5ESZdNSTIfXDapLKGvskvEQo6Xss Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:48:18.455150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc8fa61ce6ff491b9d497db42d900f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc8fa61ce6ff491b9d497db42d900f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: bc8fa61ce6ff491b9d497db42d900f50 Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813787559 Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 6c828726ae814c0f879a5aa69f647a96 Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813787559-project Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.456786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'd15930e1-efde-41f3-a7b7-0da49230281e'} Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:48:18.457591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. Oct 19 13:48:18.458910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:48:18.460022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] Returning 404 to user: Instance d15930e1-efde-41f3-a7b7-0da49230281e could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:48:18.460022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7fb85294-c48e-47ff-80f9-83c54f09693c tempest-AttachVolumeShelveTestJSON-1813787559 tempest-AttachVolumeShelveTestJSON-1813787559-project] 10.222.0.39 "GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e" status: 404 len: 111 microversion: 2.20 time: 0.029886 Oct 19 13:48:18.460022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 560/1106] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Oct 19 13:48:18 2022] GET /compute/v2.1/servers/d15930e1-efde-41f3-a7b7-0da49230281e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 13:48:34.310437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:34.310997 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:34.313544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:34.314425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:34.318798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:34.319285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:34.319717 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:34.320773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:34.320880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:34.321252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:34.410646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lazy-loading 'services' on Instance uuid 1f9ddd46-d529-42b2-946f-aa49eb37a00d {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:48:34.624824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d571d5b1-4af9-40af-817a-435eff34671b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments/bf9d0473-79b1-42ad-81d3-91b05aeb9b53" status: 202 len: 0 microversion: 2.1 time: 0.318681 Oct 19 13:48:34.625911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 547/1107] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:48:34 2022] DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments/bf9d0473-79b1-42ad-81d3-91b05aeb9b53 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:48:36.810013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:36.812009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:36.812663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=30 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:36.817431 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:36.817916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:36.818354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:36.841044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Going to try to stop instance {{(pid=125748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 13:48:37.026165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-82aadfae-b395-48f4-a5a5-4800f3fe2b8d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action" status: 202 len: 0 microversion: 2.1 time: 0.220249 Oct 19 13:48:37.026858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 561/1108] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:48:36 2022] POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:48:37.037284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:37.038344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:37.045786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:37.046272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:37.046741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:37.047433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:37.047890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:37.048456 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:37.179929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:37.188708 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-10d41cff-6b97-4a26-bb49-6c84e8607d2d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.157269 Oct 19 13:48:37.189746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 548/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:37 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:38.213945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:38.214754 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:38.221951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:38.222435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:38.222900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:38.223574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:38.224024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:38.224439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:38.351327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:38.359632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-aae1eee9-2bb9-42e8-a443-b079bb807124 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.150386 Oct 19 13:48:38.360182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 562/1110] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:38 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:39.383890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:39.384501 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:39.391338 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:39.391819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:39.392250 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:39.392933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:39.393386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:39.393811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:39.524234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:39.532041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-db5c463b-da13-4668-a781-eb9ae1d50693 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.152000 Oct 19 13:48:39.532606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 549/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:39 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:40.555392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:40.556005 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:40.562529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:40.563099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:40.563535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:40.564273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:40.564727 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:40.565182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:40.691314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:40.698915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e0794e64-c020-4475-9bb0-6910a45c37d6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.147401 Oct 19 13:48:40.699476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 563/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:40 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:41.723091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:41.723700 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:41.729977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:41.730555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:41.730985 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:41.732320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:41.732770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:41.733246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:41.864566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:41.872494 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e51864c6-bfb3-4b33-925c-8e3050d4e41d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.153292 Oct 19 13:48:41.873062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 550/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:41 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:42.895902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:42.896754 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:42.903244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:42.910885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:42.910885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:42.910885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:42.910885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:42.911244 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:43.036414 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:43.046654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0c92d9ab-3cde-4c0f-800c-ee56f28dacd8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.153953 Oct 19 13:48:43.047225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 564/1114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:42 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:44.070159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:44.070829 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:44.076711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:44.077755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:44.078196 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:44.078923 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:44.079387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:44.079819 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:44.203117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:44.210753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7538b90f-fe12-4137-96bd-bee2a8a0a986 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.144647 Oct 19 13:48:44.211318 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 551/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:44 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:45.234418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:45.235055 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:45.241388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:45.241900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:45.242336 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:45.243069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:45.243522 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:45.243945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:45.593964 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:45.601711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1e8d9019-fe09-4138-a3cd-134e53d45575 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.371225 Oct 19 13:48:45.602266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 565/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:45 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:46.624552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:46.625176 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:46.631788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:46.632273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:46.632706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:46.633402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:46.633855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:46.634282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:46.761810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:46.769929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-be7da788-cfe8-4c4e-8f48-333fc2daa6e3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.149324 Oct 19 13:48:46.770489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 552/1117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:46 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:47.793694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:47.794238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:47.801441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:47.801923 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:47.802358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:47.803072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:47.803527 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:47.803953 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:47.929578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:47.937598 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b728a167-379b-4f51-baaa-7eac6f4d3771 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.147843 Oct 19 13:48:47.938173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 566/1118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:47 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:48.876841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:48.877414 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:48.883810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:48.884329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:48.884762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:48.885457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:48.885911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:48.886333 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:48.909909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lazy-loading 'flavor' on Instance uuid 9b407371-5bdc-4da7-be24-86e041c12194 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:48:48.960992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:48.961547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:48.968249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:48.968769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:48.969240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:48.969996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:48.970467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:48.970914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:49.105569 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:49.118686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-72c18608-bf5e-49dc-8c55-27dcfe26572c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.157534 Oct 19 13:48:49.118686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 567/1119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:48 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:49.222776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d51be9bd-abe1-4f62-b74b-a92522c95565 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "POST /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194/action" status: 202 len: 0 microversion: 2.1 time: 0.350218 Oct 19 13:48:49.223321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 553/1120] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:48:48 2022] POST /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:48:49.231537 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:49.232153 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:49.238138 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:49.240226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:49.240226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:49.240226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:49.240226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:49.240706 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:49.370347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:49.378479 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-16c97146-3417-44a5-aaad-a7bc8941638c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.150859 Oct 19 13:48:49.379066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 568/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:49 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:50.139706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:50.140416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:50.146635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:50.147152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:50.147593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:50.148283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:50.148737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:50.149159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:50.277222 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:50.285796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7ff89bff-4e59-4878-9d8b-9e38a0d41eea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.150810 Oct 19 13:48:50.286667 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 554/1122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:50 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:50.401694 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:50.402413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:50.409307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:50.409786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:50.410223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:50.410926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:50.411651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:50.412072 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:50.540318 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:50.547950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3b735b52-f959-4530-913b-72ba0f39024b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.150321 Oct 19 13:48:50.548506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 569/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:50 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:51.309082 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:51.313925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:51.316891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:51.317379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:51.317929 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:51.318593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:51.319013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:51.319434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:51.447825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:51.455793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e9dbc575-0238-4c00-aef9-19c564edc2eb tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.150546 Oct 19 13:48:51.459507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 555/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:51 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:51.570739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:51.571359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:51.577455 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:51.577938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:51.578375 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:51.579104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:51.579560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:51.580018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:51.709645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:51.717480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-93a267a2-57ad-4101-8082-551b9dcf04d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.150713 Oct 19 13:48:51.723233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 570/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:51 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:52.479767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:52.480416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:52.487252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:52.487698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:52.488130 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:52.488813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:52.489263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:52.489713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:52.618006 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:52.626223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5b7da138-5d67-4774-9393-ed2decd796b1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1678 microversion: 2.1 time: 0.149861 Oct 19 13:48:52.626822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 556/1126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:52 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:52.741327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:52.741859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:52.748383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:52.748855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:52.751745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:52.751745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:52.752025 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:52.752392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:52.880231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:52.888080 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-08388900-7d1d-4358-ac1a-d2cd43aa70af tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.150966 Oct 19 13:48:52.888632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 571/1127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:52 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:53.649349 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:53.649954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:53.656363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:53.656840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:53.657274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:53.657953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:53.658398 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:53.658840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:53.785488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:53.793434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ae73e88b-f000-4501-9406-237d24ca279f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1655 microversion: 2.1 time: 0.147896 Oct 19 13:48:53.793998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 557/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:53 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:53.816472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:53.823001 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:53.823484 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:53.823921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:53.847814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Going to try to start instance {{(pid=125748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 13:48:53.911028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:53.911871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:53.917744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:53.918219 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:53.918689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:53.919393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:53.919840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:53.920261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:54.033323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-eab0dcd0-f50f-4900-913e-6f29041bf13c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action" status: 202 len: 0 microversion: 2.1 time: 0.220966 Oct 19 13:48:54.034011 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 572/1129] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:48:53 2022] POST /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:48:54.042980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:54.043668 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:54.050415 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:54.051158 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:54.051594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:54.052289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:54.052740 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:54.053156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:54.057013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:54.065935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0da9e431-4694-44e6-98f8-95eb79c65d6c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.158871 Oct 19 13:48:54.066664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 558/1130] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:53 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:54.190054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:54.196564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-de3511ae-df9c-4a61-b8f8-965ef03f5eaf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1664 microversion: 2.1 time: 0.157743 Oct 19 13:48:54.197137 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 573/1131] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:54 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:55.088523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:55.089132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:55.096324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:55.096795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:55.097228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:55.097914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:55.098363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:55.098807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:55.220837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:55.221442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:55.228259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:55.228745 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:55.229264 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:55.229972 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:55.230422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:55.230870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:55.367750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:55.376024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-25768aa5-50e3-4112-a57c-bb7d697afd33 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1664 microversion: 2.1 time: 0.159566 Oct 19 13:48:55.376590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 574/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:55 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:55.454756 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:55.462527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-186c4ca6-e434-458b-8707-bcddce8979d0 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.378031 Oct 19 13:48:55.464526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 559/1133] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:55 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:56.399669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:56.400238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:56.406549 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:56.407031 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:56.407460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:56.408787 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:56.409232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:56.409650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:56.428995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:56.485563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:56.485956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:56.492610 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:56.493095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:56.493535 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:56.494230 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:56.494714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:56.495140 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:56.543146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:56.552116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f66c7696-e3e3-4281-bcf9-d3573732bbdf tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1668 microversion: 2.1 time: 0.156491 Oct 19 13:48:56.552863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 575/1134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:56 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:56.627537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:56.631150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:56.635726 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cde0e967-f01e-4815-a2a8-31b7be39f6c3 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.154464 Oct 19 13:48:56.636290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 560/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:56 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:48:57.659468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:57.660026 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:57.667272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:57.667749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:57.668180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:57.668863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:57.669311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:57.669739 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:57.799510 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:57.807388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-673b9d24-f617-4711-9fd1-a25caa720658 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.152387 Oct 19 13:48:57.807946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 576/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:57 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:48:58.831845 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:48:58.832463 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:48:58.840579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:58.841071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:58.841513 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:58.842252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:58.842738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:58.843417 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:58.980504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:48:58.988828 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0365fef4-b447-48d4-a9dc-9836d6122840 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.161581 Oct 19 13:48:58.989423 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 561/1137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:48:58 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:00.012251 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:00.016272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:00.020537 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:00.021246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:00.021729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:00.022691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:00.023441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:00.023879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:00.162183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:00.170720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9cc849f8-9a97-40c5-9b9b-3aba96644874 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.162655 Oct 19 13:49:00.171295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 577/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:00 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:01.195056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:01.195664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:01.202714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:01.203300 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:01.203775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:01.205077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:01.205528 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:01.205951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:01.339379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:01.347469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-92b81b6c-a16d-4e5e-8ca1-6f5a27a8a97e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.156440 Oct 19 13:49:01.348036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 562/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:01 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:02.370218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:02.370876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:02.377366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:02.377847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:02.378468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:02.379066 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:02.379831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:02.380098 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:02.554115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:02.563831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ed0f98ed-94d2-441f-875e-8b207f9df8fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1568 microversion: 2.1 time: 0.196212 Oct 19 13:49:02.563831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 578/1140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:02 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:03.585054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:03.585666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:03.592275 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:03.592755 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:03.593187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:03.593869 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:03.594328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:03.595279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:03.725956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:03.734220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1cc21c54-9afa-4cdd-8e07-e1df33685247 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1569 microversion: 2.1 time: 0.153013 Oct 19 13:49:03.734817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 563/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:03 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:03.762306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:03.763228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:03.769944 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:03.770451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:03.770909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:03.771597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:03.772048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:03.772470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:03.804236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125748) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 13:49:04.157103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1cfa9423-7f00-4201-b30c-38b1b84fa007 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "POST /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194/action" status: 202 len: 0 microversion: 2.1 time: 0.399202 Oct 19 13:49:04.157717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 579/1142] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Oct 19 13:49:03 2022] POST /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:49:04.169765 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:04.171468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:04.178061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:04.178812 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:04.179256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:04.180078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:04.184258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:04.184258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:04.353632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:04.361849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9bef41e3-f3f0-41f1-9a89-be1b8b126155 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1517 microversion: 2.1 time: 0.199565 Oct 19 13:49:04.374534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 564/1143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:04 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:05.386104 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:05.386922 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:05.395243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:05.396291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:05.396948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:05.397937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:05.398851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:05.399582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:05.539687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:05.547386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c6988abb-f9a5-44d6-b0a4-6b8fbe34b0a2 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1519 microversion: 2.1 time: 0.165777 Oct 19 13:49:05.548444 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 580/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:05 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:05.935650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "name": "network-vif-unplugged", "status": "completed", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:05.941132 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=37 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:05.946346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:05.946896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:05.951767 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:05.958750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.compute.server_external_events [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] Unable to find a host for instance 9b407371-5bdc-4da7-be24-86e041c12194. Dropping event network-vif-unplugged {{(pid=125749) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 13:49:05.959618 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-c90a20b7-b986-4303-8c08-3fa10ddabe54 req-53a274c9-3e1b-4c18-9799-ac38d2117184 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028003 Oct 19 13:49:05.960177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 565/1145] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 13:49:06.571841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:06.572449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:06.578834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:06.579292 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:06.579723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:06.581038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:06.581483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:06.581900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:06.713322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:06.721123 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-df5fc407-5833-4bdb-a679-fa0c4edb0f7c tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1519 microversion: 2.1 time: 0.153126 Oct 19 13:49:06.721675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 581/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:06 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:07.745536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:07.746268 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:07.754266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:07.754625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:07.755167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:07.755966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:07.756523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:07.757049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:07.984030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:07.992032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3cb5671c-5650-4e0c-88cc-9c417959bf6b tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.250899 Oct 19 13:49:07.992688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 566/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:07 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:09.016647 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:09.017770 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:09.020240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:09.024930 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:09.025433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:09.025870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:09.026584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:09.027041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:09.027465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:09.154444 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:09.163201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c59294ab-fad4-4651-b318-baf15ac4b1e4 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.150550 Oct 19 13:49:09.163795 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 582/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:09 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:10.185207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:10.185849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:10.192154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:10.192634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:10.193072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:10.193753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:10.194209 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:10.194669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:10.328154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:10.336042 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-630e840d-5076-45e5-beee-a125b856b91e tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.154727 Oct 19 13:49:10.336613 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 567/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:10 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:11.359279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:11.359895 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:11.366738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:11.367221 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:11.367657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:11.368352 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:11.368808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:11.369232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:11.498493 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:11.506802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8a3a88b8-d57d-46b7-b36f-1bd64cd3d7ed tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.151481 Oct 19 13:49:11.507424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 583/1150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:11 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:12.529008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:12.529624 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:12.536299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:12.539336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:12.539336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:12.539336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:12.539336 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:12.539793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:12.667620 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:12.675411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a1348e87-1188-4e38-b674-dfd55b4140d8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.150190 Oct 19 13:49:12.675970 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 568/1151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:12 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:13.698230 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:13.698860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:13.706070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:13.706688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:13.707119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:13.707798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:13.708242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:13.708658 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:13.843041 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:13.850768 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-15480fe2-85eb-430f-9f79-8b0186a6188d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.156334 Oct 19 13:49:13.851332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 584/1152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:13 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:14.873262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:14.873875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:14.879988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:14.880459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:14.880889 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:14.881564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:14.882007 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:14.882425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:15.015002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:15.023702 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-26f25bf9-932d-463b-9bf1-bd98012d1fd9 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.154398 Oct 19 13:49:15.024270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 569/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:14 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:16.047816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:16.048921 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:16.055204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:16.055688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:16.056130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:16.056818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:16.057272 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:16.057695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:16.188483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:16.196517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6220754e-24c3-449f-a5ec-ede9af140cf6 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.152757 Oct 19 13:49:16.202655 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 585/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:16 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:17.219279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:17.219817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:17.226229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:17.226716 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:17.227150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:17.227830 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:17.228278 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:17.228696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:17.358089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:17.366211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d2c17b07-b2ea-4ad9-b95d-587ca9ef8c57 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.150782 Oct 19 13:49:17.367946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 570/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:17 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:17.891500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "name": "network-vif-plugged", "status": "completed", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:17.906339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:17.906837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:17.907266 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:17.919203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] Creating event network-vif-plugged:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:49:17.924486 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-675c95de-3965-4571-aecd-5e05d77b2852 req-9e2a70bb-9225-4133-820a-44ce497e0698 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042281 Oct 19 13:49:17.929397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 586/1156] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:18.389215 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:18.389825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:18.396867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:18.397344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:18.397786 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:18.398469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:18.398951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:18.399374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:18.530023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:18.538151 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d5fe0c5d-a618-484d-8153-16ad46898dc8 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.152809 Oct 19 13:49:18.538807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 571/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:18 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:19.562451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:19.563180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:19.569349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:19.569834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:19.570274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:19.570993 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:19.571451 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:19.571879 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:19.710123 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:19.718108 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5674a2fe-ff2b-4da0-8741-2f9d624af188 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1575 microversion: 2.1 time: 0.160569 Oct 19 13:49:19.718708 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 587/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:19 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:20.741773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:20.742385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:20.748727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:20.749203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:20.749634 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:20.750306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:20.750833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:20.751253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:20.877496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:20.885607 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e5890b2d-9b74-4cb7-a102-3c1320f67c6d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1562 microversion: 2.1 time: 0.148355 Oct 19 13:49:20.886156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 572/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:20 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:30.372679 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-745835789", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:30.380452 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=11 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:30.381121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:30.428296 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] validate_networks() for None {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:49:30.692458 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:49:30.692881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:49:30.693351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:49:30.693755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:49:30.694159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:49:30.702691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.703171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.703599 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.704311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.704757 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.705174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.721234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Getting quotas for project 152b4e4be03746349f79a6bd119c75a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:49:30.725099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Getting quotas for user 06f39f80c50f46e799e8ae23e9029d67 and project 152b4e4be03746349f79a6bd119c75a3. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:49:30.735750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:49:30.738453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:49:30.869928 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-19ed153c-4904-4a65-82bb-2d5008f87979 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501123 Oct 19 13:49:30.870611 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 588/1160] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:49:30.882302 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-90b52a3b-5a6f-4fff-b2ac-16c76b4320aa tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:30.882944 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-90b52a3b-5a6f-4fff-b2ac-16c76b4320aa tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:30.885386 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=15 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:30.886053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=68 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:30.936023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-90b52a3b-5a6f-4fff-b2ac-16c76b4320aa tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:30.944262 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-90b52a3b-5a6f-4fff-b2ac-16c76b4320aa tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1214 microversion: 2.1 time: 0.066473 Oct 19 13:49:30.944825 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 573/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:30 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:31.967948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-7fe113e4-2810-4ce6-a77e-b57fed1c2e12 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:31.968562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-7fe113e4-2810-4ce6-a77e-b57fed1c2e12 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:32.020841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-7fe113e4-2810-4ce6-a77e-b57fed1c2e12 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:32.027788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-7fe113e4-2810-4ce6-a77e-b57fed1c2e12 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1214 microversion: 2.1 time: 0.064888 Oct 19 13:49:32.028345 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 589/1162] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:31 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:33.050675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-50eec49d-1f80-4deb-818a-31610c15542b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:33.051283 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-50eec49d-1f80-4deb-818a-31610c15542b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:33.104368 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-50eec49d-1f80-4deb-818a-31610c15542b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:33.111129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-50eec49d-1f80-4deb-818a-31610c15542b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1214 microversion: 2.1 time: 0.064494 Oct 19 13:49:33.111707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 574/1163] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:33 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:34.133638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2b58eed2-cac2-45cf-be5f-067bd63506a7 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:34.134247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2b58eed2-cac2-45cf-be5f-067bd63506a7 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:34.184349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2b58eed2-cac2-45cf-be5f-067bd63506a7 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:34.190924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2b58eed2-cac2-45cf-be5f-067bd63506a7 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1214 microversion: 2.1 time: 0.061246 Oct 19 13:49:34.191483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 590/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:34 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:35.213471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:35.214008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:35.220397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.220876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.221871 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.222580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.223034 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.223462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.284802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:35.292531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-51e729de-c0a9-4465-a7d9-75c01c36962d tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1218 microversion: 2.1 time: 0.083075 Oct 19 13:49:35.293097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 575/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:35 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:36.315911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:36.316516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:36.323503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.323981 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.324409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.325112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.325554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.325968 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.387996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:36.396319 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cf364a98-8baa-4027-9041-f70d5472408a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1210 microversion: 2.1 time: 0.084842 Oct 19 13:49:36.396861 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 591/1166] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:36 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:37.424036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:37.424802 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:37.431259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.431895 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.432335 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.433636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.434238 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.434713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.525780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:37.534280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-15036b01-feaf-49c3-9455-17375a13a2cd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1284 microversion: 2.1 time: 0.113676 Oct 19 13:49:37.538258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 576/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:37 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:38.560724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:38.562017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:38.570085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.570851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.571460 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.572165 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.572782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.573366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.783755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:38.791965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cb182654-0bca-4951-8a68-ada1451957c4 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.237297 Oct 19 13:49:38.806939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 592/1168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:38 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:39.465896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:39.467054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:39.468493 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe843cdb-f631-48b9-87ff-607cb65ea223", "tag": "c348fc2c-dac2-47f2-a88e-cfb3454fc242"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:39.474104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.474638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.475071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.475770 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.476228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.476660 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.479189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.479662 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.480218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.494400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] Creating event network-changed:c348fc2c-dac2-47f2-a88e-cfb3454fc242 for instance fe843cdb-f631-48b9-87ff-607cb65ea223 on hv-cinder-86188 Oct 19 13:49:39.499870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-27a6ef58-3edc-4cdb-9fdc-acf37f00813b req-92164ff4-305a-43a4-9956-337940c9611f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035140 Oct 19 13:49:39.501621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 593/1169] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:39.504204 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:49:39.539877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2aa28ce-f08a-4273-a008-74a73b6a485e", "tag": "75025ff7-801c-48e3-ac80-b3a9567f7a1c"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:39.552233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.555695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.555695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.568572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] Creating event network-changed:75025ff7-801c-48e3-ac80-b3a9567f7a1c for instance f2aa28ce-f08a-4273-a008-74a73b6a485e on hv-cinder-86188 Oct 19 13:49:39.589565 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-ab3be8e0-1366-4d89-9bdb-cad029831a8a req-a087254e-28fd-4c6b-8d81-d93392c18f31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053694 Oct 19 13:49:39.590559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 594/1170] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:49:39.806124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5dd4b1dd-5a51-41fd-a305-89a3db0b6495 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 204 len: 0 microversion: 2.1 time: 0.344004 Oct 19 13:49:39.807136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 577/1171] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:49:39 2022] DELETE /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:49:39.817992 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:39.818792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:39.827552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:39.828259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:39.833089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.836773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.836773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.836773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.836773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.837134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.845780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.852191 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.852646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:39.853372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:39.853832 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:39.854265 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:40.013943 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:40.021401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:40.026592 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-aab9bfd7-2a66-4838-b58b-15856f67eb3b tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1578 microversion: 2.1 time: 0.214456 Oct 19 13:49:40.027681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 595/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:39 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:40.030266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-86272235-b7f0-4aae-8deb-394d86ec17e1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.206923 Oct 19 13:49:40.030863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 578/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:39 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:41.052324 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:41.052937 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:41.054961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:41.055422 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:41.056272 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:41.060910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:41.061927 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:41.062621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:41.063146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:41.063327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:41.063780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:41.063904 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:41.064205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:41.064357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:41.065071 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:41.065523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:41.065941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:41.198097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:41.207264 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3ca7d7b2-de07-4128-ac90-1d09289586f4 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1578 microversion: 2.1 time: 0.159326 Oct 19 13:49:41.217859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 596/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:41 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:41.249000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:41.256697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-efa64228-fd2b-44ea-b834-b1fbadfb7570 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.205734 Oct 19 13:49:41.257195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 579/1175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:41 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:42.231226 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:42.231781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:42.238891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:42.239378 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:42.239818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:42.240511 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:42.240966 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:42.241393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:42.279559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:42.280260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:42.287641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:42.288160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:42.288606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:42.289359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:42.289824 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:42.290252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:42.381366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:42.389468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f1d51d5c-53a8-457e-ac5b-c1da1fca1df9 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1459 microversion: 2.1 time: 0.162337 Oct 19 13:49:42.390034 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 597/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:42 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1459 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:42.413480 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe843cdb-f631-48b9-87ff-607cb65ea223", "name": "network-vif-deleted", "tag": "c348fc2c-dac2-47f2-a88e-cfb3454fc242"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:42.422915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:42.423389 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:42.423863 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:42.435949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] Creating event network-vif-deleted:c348fc2c-dac2-47f2-a88e-cfb3454fc242 for instance fe843cdb-f631-48b9-87ff-607cb65ea223 on hv-cinder-86188 Oct 19 13:49:42.441170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-4c111519-e4f8-4703-824f-ff7403633c4a req-0d8db2a9-a08d-4344-9222-056c3517e2c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Oct 19 13:49:42.442359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 598/1177] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:49:42.470527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:42.478490 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9bb5d9fd-c43e-495a-9129-484e5cf86e5e tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.202855 Oct 19 13:49:42.479062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 580/1178] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:42 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:43.414027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:43.414769 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:43.421355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:43.421831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:43.422269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:43.422974 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:43.423423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:43.424416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:43.501050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:43.501668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:43.504264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=4 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:43.509428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:43.509909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:43.510346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:43.511092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:43.511549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:43.518325 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:43.594110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:43.602093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8ab0f975-c66c-4789-a369-246569f7df65 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1391 microversion: 2.1 time: 0.192614 Oct 19 13:49:43.602692 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 599/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:43 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:43.640382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:43.647885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c8898a17-b3b9-432a-b7f7-ec34a363a760 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.150734 Oct 19 13:49:43.648433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 581/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:43 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:44.625553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:44.626174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:44.628686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=10 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:44.633901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:44.636408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:44.636408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:44.636408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:44.636408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:44.636785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:44.670808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:44.671488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:44.677467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:44.677875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:44.678308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:44.679022 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:44.679475 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:44.679987 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:44.699307 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:44.707833 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ad7f14ae-2f7e-4f2b-9e0d-52ea9effcd20 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1391 microversion: 2.1 time: 0.086113 Oct 19 13:49:44.708406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 600/1181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:44 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:44.861983 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:44.869632 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8fb610d6-14ee-48a3-9e3f-384a5eeac91a tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.202842 Oct 19 13:49:44.870382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 582/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:44 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:45.731223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:45.731806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:45.738252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:45.738772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:45.739209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:45.739897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:45.740351 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:45.740790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:45.802482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:45.812173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c6658792-d0bb-4feb-bc4e-4f22a7c73a10 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 200 len: 1225 microversion: 2.1 time: 0.084843 Oct 19 13:49:45.813162 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 601/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:45 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:45.893650 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:45.894270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:45.900742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:45.901228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:45.901693 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:45.902354 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:45.902841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:45.903270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:46.039564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:46.047321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d69e85d8-e244-4060-a83e-396638504bcd tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.158149 Oct 19 13:49:46.047910 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 583/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:45 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:46.834564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:46.835182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: fe843cdb-f631-48b9-87ff-607cb65ea223] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:46.841652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:46.843893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:46.843893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:46.843893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:46.843893 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:46.844321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:46.859146 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] HTTP exception thrown: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Request method failure captured: Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 HTTP/1.1 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_4MmY2FeTQgF_kDfmKIeq6YwETcSYiSLBlvTNMM89KO7pSX637HAgjgBZUZFee0VRgLqgFHwJuvc4szVPX_t8d3hhJ47-jPuVX3PPHte3fJLxoxb7Tz9alJiEmd-tzqsi348huN-uyg4rJYI2PrreGb7x4Ih3bb3mDQjBMUPJd9Shk Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:49:46.860825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a1c12d9a4454de59ed63d3cedb71a58", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: e7a6ae7333d2422ebc9f616d482e527a Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. Oct 19 13:49:46.868360 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'fe843cdb-f631-48b9-87ff-607cb65ea223'} Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:46.869870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. Oct 19 13:49:46.871564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:46.872969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Returning 404 to user: Instance fe843cdb-f631-48b9-87ff-607cb65ea223 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:46.872969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9f26d4cc-3ecc-4d58-9c2a-7eb65c5c487a tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223" status: 404 len: 111 microversion: 2.1 time: 0.031884 Oct 19 13:49:46.872969 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 602/1185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:46 2022] GET /compute/v2.1/servers/fe843cdb-f631-48b9-87ff-607cb65ea223 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:49:47.070595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:47.071152 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:47.077651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:47.078156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:47.078599 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:47.079294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:47.079753 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:47.080801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:47.212513 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:47.218530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-33a67d6d-e82d-40d8-a89a-8c62e628226b tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.152054 Oct 19 13:49:47.219095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 584/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:47 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:48.031429 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aa28ce-f08a-4273-a008-74a73b6a485e", "name": "network-vif-plugged", "status": "completed", "tag": "75025ff7-801c-48e3-ac80-b3a9567f7a1c"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:48.041532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:48.047256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:48.047256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:48.053884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] Creating event network-vif-plugged:75025ff7-801c-48e3-ac80-b3a9567f7a1c for instance f2aa28ce-f08a-4273-a008-74a73b6a485e on hv-cinder-86188 Oct 19 13:49:48.059091 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-d9ac07b5-4af4-48cc-b91f-95f9e4565de5 req-05011761-a349-4fa0-b004-a8714692e46d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031462 Oct 19 13:49:48.059719 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 603/1187] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:48.241121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:48.241727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:48.248440 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:48.248837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:48.249345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:48.250038 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:48.250487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:48.251072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:48.383801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:48.391523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6812bae8-25de-423b-aa74-ec47b1677007 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.154361 Oct 19 13:49:48.392095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 585/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:48 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:49.416020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:49.416713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:49.422770 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:49.423306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:49.423830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:49.424471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:49.424934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:49.425349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:49.617114 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:49.624637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c38d006c-e404-4191-bb48-b9d3f478a5df tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1314 microversion: 2.1 time: 0.213250 Oct 19 13:49:49.625198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 604/1189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:49 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:50.474949 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e034f877-4abe-4014-8097-62fd05e67978", "tag": "2ff93784-b640-46c6-b8f6-cf8b1abac5f5"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:50.478763 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:50.479263 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:50.485349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.485837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.485958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.486884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.487008 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.487319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.488094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.488557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.488982 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.512608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] Creating event network-changed:2ff93784-b640-46c6-b8f6-cf8b1abac5f5 for instance e034f877-4abe-4014-8097-62fd05e67978 on hv-cinder-86188 Oct 19 13:49:50.518914 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-709e4451-0284-4d4b-b8fd-b894f0f92a07 req-5970530a-0c80-4ff5-8bab-cd7ab577aa0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047471 Oct 19 13:49:50.519577 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 605/1190] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:50.522636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:49:50.649973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:50.651304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:50.661571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.662223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.662759 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.663758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.664346 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.664948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.817588 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-42c486cc-e57c-44ae-af57-ba1a55da2bab tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 204 len: 0 microversion: 2.1 time: 0.348209 Oct 19 13:49:50.820203 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 586/1191] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:49:50 2022] DELETE /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:49:50.832371 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:50.834135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:50.835201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:50.848227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.848227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.848645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ec9d20f0-c0c1-41db-a50b-c97374edf5e5 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1464 microversion: 2.1 time: 0.200812 Oct 19 13:49:50.848771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.848771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.848973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 606/1192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:50 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1464 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:50.849078 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.849656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.900156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:50.901128 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:50.909903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.910400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.910880 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.911589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:50.912054 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:50.912468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:50.945449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:49:50.998227 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:51.006780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c3941148-68c2-4555-9577-e3ea79f3dc09 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1578 microversion: 2.1 time: 0.182270 Oct 19 13:49:51.007445 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 587/1193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:50 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:51.199418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-44478881-97dc-4411-b648-8f17011fcc74 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 204 len: 0 microversion: 2.1 time: 0.303398 Oct 19 13:49:51.199998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 607/1194] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:49:50 2022] DELETE /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:49:51.209339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:51.209720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:51.224788 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:51.225488 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:51.225707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:51.227212 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:51.227675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:51.228274 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:51.232853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:51.376141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:51.384868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aae228b7-118c-4d8c-b847-61351d7b8c58 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1470 microversion: 2.1 time: 0.180237 Oct 19 13:49:51.402823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 588/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:51 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:52.031543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:52.032238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:52.039608 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:52.040085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:52.040515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:52.041194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:52.041641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:52.042059 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:52.178632 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:52.186215 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2c5c8c49-4420-4171-8d75-bd5b076ed8af tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1578 microversion: 2.1 time: 0.159141 Oct 19 13:49:52.186806 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 608/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:52 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:52.409931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:52.410598 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:52.417092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:52.417570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:52.418003 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:52.418718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:52.419177 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:52.419606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:52.548898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:52.556555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0f6237e0-daab-4fb6-8975-250ec71a5ee1 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1470 microversion: 2.1 time: 0.151226 Oct 19 13:49:52.557076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 589/1197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:52 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:53.210157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:53.210732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:53.217212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:53.217686 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:53.218116 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:53.218830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:53.219280 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:53.219693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:53.238690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:53.349744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:53.357387 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-74941898-8795-4f6b-97cb-8c8ac932877c tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1460 microversion: 2.1 time: 0.151186 Oct 19 13:49:53.357942 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 609/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:53 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1460 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:53.578531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:53.579162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:53.586411 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:53.586934 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:53.587371 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:53.588054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:53.588507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:53.588932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:53.786063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:53.793757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5892eee6-3105-498d-a662-eb104bb5b39c tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1470 microversion: 2.1 time: 0.219055 Oct 19 13:49:53.794323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 590/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:53 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:54.382428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:54.382954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:54.389582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:54.390112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:54.390555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:54.391305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:54.391755 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:54.392852 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:54.529624 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:54.538406 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2d319889-607d-4d51-9006-0c9fa0e06474 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1460 microversion: 2.1 time: 0.161685 Oct 19 13:49:54.539111 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 610/1200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:54 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:54.749350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2aa28ce-f08a-4273-a008-74a73b6a485e", "name": "network-vif-deleted", "tag": "75025ff7-801c-48e3-ac80-b3a9567f7a1c"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:54.762675 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:54.763264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:54.764530 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:54.778727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] Creating event network-vif-deleted:75025ff7-801c-48e3-ac80-b3a9567f7a1c for instance f2aa28ce-f08a-4273-a008-74a73b6a485e on hv-cinder-86188 Oct 19 13:49:54.785220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-8b7d8828-94ed-4668-9d0a-c2f12b0b4cdc req-ebb9fb3b-5774-410d-9fba-b1b4a8dd4cf5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040519 Oct 19 13:49:54.785906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 591/1201] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:54.818675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:54.819304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:54.825681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:54.826247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:54.826763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:54.827459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:54.828096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:54.828531 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:54.889873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:54.898133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9d8231d7-892c-48ed-92b9-4afe7249d875 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1428 microversion: 2.1 time: 0.084664 Oct 19 13:49:54.898720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 611/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:54 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:55.563280 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:55.564561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:55.570799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.571224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.571681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.572351 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.572810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.573236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.605030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.605504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.605939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.606379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lazy-loading 'fault' on Instance uuid e034f877-4abe-4014-8097-62fd05e67978 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:49:55.646867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a6ae7333d2422ebc9f616d482e527a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1c12d9a4454de59ed63d3cedb71a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:55.654436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-27b41bdc-2dac-400f-8ef2-e43b93139fe2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 200 len: 1230 microversion: 2.1 time: 0.095383 Oct 19 13:49:55.655027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 592/1203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:55 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:55.922385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:55.927690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:55.930691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.931269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.931774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.932673 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.933161 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.933586 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.965145 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:55.965625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:55.966058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:55.966501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lazy-loading 'fault' on Instance uuid f2aa28ce-f08a-4273-a008-74a73b6a485e {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:49:56.010157 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06f39f80c50f46e799e8ae23e9029d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152b4e4be03746349f79a6bd119c75a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:56.018259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6ccfaceb-0d03-4072-b8e3-a46218eb0f37 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 200 len: 1304 microversion: 2.1 time: 0.099651 Oct 19 13:49:56.019277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 612/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:55 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:56.677732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:56.678344 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: e034f877-4abe-4014-8097-62fd05e67978] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:56.684759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:56.685241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:56.685670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:56.686384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:56.686874 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:56.687296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:56.700813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] HTTP exception thrown: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Request method failure captured: Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 HTTP/1.1 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_4MmY2FeTQgF_kDfmKIeq6YwETcSYiSLBlvTNMM89KO7pSX637HAgjgBZUZFee0VRgLqgFHwJuvc4szVPX_t8d3hhJ47-jPuVX3PPHte3fJLxoxb7Tz9alJiEmd-tzqsi348huN-uyg4rJYI2PrreGb7x4Ih3bb3mDQjBMUPJd9Shk Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:49:56.702420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a1c12d9a4454de59ed63d3cedb71a58", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: e7a6ae7333d2422ebc9f616d482e527a Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. Oct 19 13:49:56.704086 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'e034f877-4abe-4014-8097-62fd05e67978'} Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:56.705601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. Oct 19 13:49:56.707163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:56.708807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Returning 404 to user: Instance e034f877-4abe-4014-8097-62fd05e67978 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:56.708807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-cf7da82b-92be-4a4b-8a1b-c961ba31cecf tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978" status: 404 len: 111 microversion: 2.1 time: 0.030044 Oct 19 13:49:56.708807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 593/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:56 2022] GET /compute/v2.1/servers/e034f877-4abe-4014-8097-62fd05e67978 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:49:56.811187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e034f877-4abe-4014-8097-62fd05e67978", "name": "network-vif-deleted", "tag": "2ff93784-b640-46c6-b8f6-cf8b1abac5f5"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:56.821294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:56.821807 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:56.822241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:56.833855 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] Creating event network-vif-deleted:2ff93784-b640-46c6-b8f6-cf8b1abac5f5 for instance e034f877-4abe-4014-8097-62fd05e67978 on hv-cinder-86188 Oct 19 13:49:56.838857 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-47fc5cfd-8a37-42ad-a158-8e64fa8d4e9d req-1fa1c139-7b45-4321-b266-f76e9f8965fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Oct 19 13:49:56.839647 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 613/1206] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:57.041302 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:57.041914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] [instance: f2aa28ce-f08a-4273-a008-74a73b6a485e] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:57.047900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.048905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.049343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.050025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.050478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.050925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.064657 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] HTTP exception thrown: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Request method failure captured: Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e HTTP/1.1 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUABnYPBobQ38pFmIHZkO0BLoa-FhuM2ThhbEHoemp-flhVhE9426JzIq5gViEB9PVL0U2SsndUqJMC4Hx02eeljdtC64PlTn5AdGPftS0emIYOlwUYOmhDRFxVZFZ9i4SsSSrPfq2FhFsu2I70GDTjJu5m1GBye0oJobARVjmUeyiVk Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 152b4e4be03746349f79a6bd119c75a3 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesNegativeTest-1030123093 Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:49:57.066169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/152b4e4be03746349f79a6bd119c75a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_152b4e4be03746349f79a6bd119c75a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/152b4e4be03746349f79a6bd119c75a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/152b4e4be03746349f79a6bd119c75a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesNegativeTest-1030123093 Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 152b4e4be03746349f79a6bd119c75a3 Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesNegativeTest-1030123093 Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesNegativeTest-1030123093-project Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 06f39f80c50f46e799e8ae23e9029d67 Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesNegativeTest-1030123093-project Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. Oct 19 13:49:57.076671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'f2aa28ce-f08a-4273-a008-74a73b6a485e'} Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:57.078433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. Oct 19 13:49:57.080011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.081401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] Returning 404 to user: Instance f2aa28ce-f08a-4273-a008-74a73b6a485e could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:57.081401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-686806cf-ec2f-4be4-a1b7-84900031c788 tempest-VolumesNegativeTest-1030123093 tempest-VolumesNegativeTest-1030123093-project] 10.222.0.39 "GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e" status: 404 len: 111 microversion: 2.1 time: 0.030228 Oct 19 13:49:57.081401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 594/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:57 2022] GET /compute/v2.1/servers/f2aa28ce-f08a-4273-a008-74a73b6a485e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:49:57.199561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:57.200147 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:57.210978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.210978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.210978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.210978 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.211357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.211357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.223327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] HTTP exception thrown: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Request method failure captured: Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 HTTP/1.1 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_4MmY2FeTQgF_kDfmKIeq6YwETcSYiSLBlvTNMM89KO7pSX637HAgjgBZUZFee0VRgLqgFHwJuvc4szVPX_t8d3hhJ47-jPuVX3PPHte3fJLxoxb7Tz9alJiEmd-tzqsi348huN-uyg4rJYI2PrreGb7x4Ih3bb3mDQjBMUPJd9Shk Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:49:57.224958 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a1c12d9a4454de59ed63d3cedb71a58", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: e7a6ae7333d2422ebc9f616d482e527a Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.226788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '5530fa5a-76ad-4149-99bd-909c686e1e79'} Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:57.227789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.229377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.233959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Returning 404 to user: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:57.233959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-cc728649-8256-4c8f-aa2f-ed42a0eb3392 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 404 len: 111 microversion: 2.1 time: 0.032427 Oct 19 13:49:57.233959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 614/1208] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:49:57 2022] DELETE /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:49:57.235105 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:57.235748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] [instance: 5530fa5a-76ad-4149-99bd-909c686e1e79] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:57.241735 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.242267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.242685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.243369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:57.243823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:57.244247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:57.257286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] HTTP exception thrown: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Request method failure captured: Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 HTTP/1.1 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_4MmY2FeTQgF_kDfmKIeq6YwETcSYiSLBlvTNMM89KO7pSX637HAgjgBZUZFee0VRgLqgFHwJuvc4szVPX_t8d3hhJ47-jPuVX3PPHte3fJLxoxb7Tz9alJiEmd-tzqsi348huN-uyg4rJYI2PrreGb7x4Ih3bb3mDQjBMUPJd9Shk Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:49:57.258823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a1c12d9a4454de59ed63d3cedb71a58", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a1c12d9a4454de59ed63d3cedb71a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a1c12d9a4454de59ed63d3cedb71a58 Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984069092 Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: e7a6ae7333d2422ebc9f616d482e527a Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestVolumeBootPattern-1984069092-project Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '5530fa5a-76ad-4149-99bd-909c686e1e79'} Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:57.261457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. Oct 19 13:49:57.263043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:49:57.264427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Returning 404 to user: Instance 5530fa5a-76ad-4149-99bd-909c686e1e79 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:57.264427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-45310243-b12f-4247-bb05-8f4624686f93 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79" status: 404 len: 111 microversion: 2.1 time: 0.029095 Oct 19 13:49:57.264427 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 595/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:57 2022] GET /compute/v2.1/servers/5530fa5a-76ad-4149-99bd-909c686e1e79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:49:58.884621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1f0d4a38-d090-4a12-8090-3596e9c60da2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] Calling method '.version_select at 0x7fb41e4c89d0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:58.983612 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1f0d4a38-d090-4a12-8090-3596e9c60da2 tempest-TestVolumeBootPattern-1984069092 tempest-TestVolumeBootPattern-1984069092-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-857404674" status: 202 len: 0 microversion: 2.1 time: 0.102964 Oct 19 13:49:58.984197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 615/1210] 10.222.0.39 () {58 vars in 1260 bytes} [Wed Oct 19 13:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-857404674 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:50:03.319756 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:03.322057 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:03.325948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:03.330290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.330818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.331253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.331958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.332410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.333159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.365151 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-893d1e76-076c-4688-a4d1-be81f611b3ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049421 Oct 19 13:50:03.365810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 596/1211] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:50:03 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:50:03.433420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:03.433927 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:03.438442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:03.441847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.442333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.442798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.443492 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.443946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.444370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.471229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:50:03.777791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-6acdedaa-52b5-4966-bbe4-9f84ce6dbe27 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 204 len: 0 microversion: 2.1 time: 0.347496 Oct 19 13:50:03.788794 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 616/1212] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:50:03 2022] DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:50:03.790852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:03.791966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:03.800616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.802771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.803401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.804470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:03.805430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:03.805932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:03.998428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:04.008707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-21042212-f991-436d-8530-d70da721beb6 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1674 microversion: 2.1 time: 0.223388 Oct 19 13:50:04.031773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 597/1213] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:03 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:05.040301 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:05.040996 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:05.047305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:05.047802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:05.052225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:05.052225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:05.052225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:05.052225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:05.181290 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:05.190188 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-168ebfb3-6c05-4ddc-be75-f46441b0acde tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1674 microversion: 2.1 time: 0.154809 Oct 19 13:50:05.190785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 617/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:05 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:06.213730 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:06.214328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:06.221733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:06.222217 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:06.222683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:06.223379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:06.223836 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:06.224259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:06.292306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:06.304343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dae630cb-37ad-4663-9c9f-cf0d940bd45f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1606 microversion: 2.1 time: 0.094378 Oct 19 13:50:06.320801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 598/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:06 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:06.464076 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9ddd46-d529-42b2-946f-aa49eb37a00d", "name": "network-vif-deleted", "tag": "c44cee20-ef54-4c0d-a74a-7a2bb797b1d3"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:06.475986 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:06.476871 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:06.479453 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:06.493775 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] Creating event network-vif-deleted:c44cee20-ef54-4c0d-a74a-7a2bb797b1d3 for instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d on hv-cinder-86188 Oct 19 13:50:06.498915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-e9a99b79-4909-4c98-a226-7bcc8a8ceac4 req-4f65dbd9-a2cf-4e16-b309-2976af6e7e4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038388 Oct 19 13:50:06.511089 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 618/1216] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:50:07.330732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:07.331276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:07.341950 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:07.342452 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:07.343356 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:07.344223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:07.345441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:07.346053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:07.379321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:07.379822 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:07.380296 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:07.380743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lazy-loading 'fault' on Instance uuid 1f9ddd46-d529-42b2-946f-aa49eb37a00d {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:50:07.423121 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:07.431306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8bc309bb-f9c6-4a76-8c5a-e1380054dc01 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 200 len: 1327 microversion: 2.1 time: 0.104644 Oct 19 13:50:07.431891 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 599/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:07 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:08.456125 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:08.456829 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:08.463079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:08.463562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:08.464003 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:08.464736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:08.465194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:08.465619 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:08.479412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d HTTP/1.1 Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:50:08.484070 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:50:08.485711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '1f9ddd46-d529-42b2-946f-aa49eb37a00d'} Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:50:08.486672 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:50:08.488169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:50:08.489631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:50:08.489631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-bbf63c9e-4b92-4673-9242-e1cd940a956d tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 404 len: 111 microversion: 2.1 time: 0.031926 Oct 19 13:50:08.489631 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 619/1218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:08 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:50:08.491343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-4c4df56d-4e05-4597-99cd-23fb70a02598 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '.version_select at 0x7fb41e8a2670>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:08.575525 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-4c4df56d-4e05-4597-99cd-23fb70a02598 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204629068" status: 202 len: 0 microversion: 2.1 time: 0.087922 Oct 19 13:50:08.576040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 600/1219] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204629068 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:50:09.349864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-352f6c25-2f71-4d02-ac08-66dbbc9095cd tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: .version_select at 0x7fb41e3c9160>, body: {"keypair": {"name": "tempest-keypair-54656529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgnTwyLilsGAEqjGMZaJJnmv0oyu2bfsFD0aTBKIz3SfRw05yuCO6UkmGIEz53GpBTsxz3Tc1d96UR4F4qMigX4ZcS8xEL9KWycbcZVunhyC2QTCh3UDY396IZMcZI59w=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:09.364912 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-352f6c25-2f71-4d02-ac08-66dbbc9095cd tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:50:09.368743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-352f6c25-2f71-4d02-ac08-66dbbc9095cd tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for user c996056bd0354124ae74e79abf2753a8 and project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:50:09.455991 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-352f6c25-2f71-4d02-ac08-66dbbc9095cd tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.110054 Oct 19 13:50:09.456579 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 620/1220] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:50:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:50:12.081885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-415133979", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ced57eb0-c373-4819-a5ad-31424570b450"}], "security_groups": [{"name": "tempest-securitygroup--453071896"}], "key_name": "tempest-keypair-54656529", "user_data": "}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:12.182813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] validate_networks() for [('ced57eb0-c373-4819-a5ad-31424570b450', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:50:12.540457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:50:12.540884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:50:12.541360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:50:12.541800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:50:12.542220 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:50:12.550924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:12.551401 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:12.551837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:12.552560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:12.553014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:12.553438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:12.570857 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:50:12.574851 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Getting quotas for user c996056bd0354124ae74e79abf2753a8 and project 723dfd3a60ee412b8569bb0a6081dc7a. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:50:12.586244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:50:12.588516 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:50:12.738359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-220daa95-65f7-4b46-b234-9dccbf5d836a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661212 Oct 19 13:50:12.738961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 601/1221] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:50:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:50:12.751445 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3b215264-e4bd-43c7-8f0f-9c826f9442b0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:12.752071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3b215264-e4bd-43c7-8f0f-9c826f9442b0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:12.807241 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3b215264-e4bd-43c7-8f0f-9c826f9442b0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:12.814735 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3b215264-e4bd-43c7-8f0f-9c826f9442b0 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1235 microversion: 2.1 time: 0.068597 Oct 19 13:50:12.815291 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 621/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:12 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:13.837852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:13.838480 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:13.844746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:13.845155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:13.845595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:13.846279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:13.846774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:13.859217 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:13.910111 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:13.917743 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3df40bf5-9c1d-4c44-a92f-5f08a8872819 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1239 microversion: 2.1 time: 0.084356 Oct 19 13:50:13.918294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 602/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:13 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:14.940501 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:14.941851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:14.949496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:14.950086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:14.950548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:14.951243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:14.951786 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:14.952207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:15.017354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:15.025197 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5850d933-29f7-4b16-a06a-ca5382cc968b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1305 microversion: 2.1 time: 0.088552 Oct 19 13:50:15.038535 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 622/1224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:14 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:16.053939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:16.054592 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:16.060564 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:16.061083 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:16.061524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:16.062216 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:16.062875 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:16.063333 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:16.255063 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:16.262848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8c7d3ff9-2a2b-4858-b4b8-b0ab28a119ec tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.212930 Oct 19 13:50:16.263413 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 603/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:16 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:16.442813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330db521-9212-4f13-ad5d-6556d932e0cc", "tag": "57ffa0a2-e01b-4cce-a9af-5ba10000df8c"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:16.454737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:16.455010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:16.455504 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:16.466778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] Creating event network-changed:57ffa0a2-e01b-4cce-a9af-5ba10000df8c for instance 330db521-9212-4f13-ad5d-6556d932e0cc on hv-cinder-86188 Oct 19 13:50:16.472329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-afa3f657-0aa5-4440-9d87-823aae5ddb9f req-eecae4a5-79cd-413a-a358-3bfeec96361b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Oct 19 13:50:16.472911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 623/1226] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:50:17.286907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:17.287441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:17.294097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:17.294626 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:17.295076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:17.295776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:17.296237 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:17.296665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:17.487074 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:17.494665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7e57ce6d-4a3d-4662-b05a-9537bedff48c tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.211996 Oct 19 13:50:17.495245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 604/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:17 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:18.519423 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:18.520113 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:18.526434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:18.526951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:18.527383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:18.528065 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:18.528516 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:18.528941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:18.657816 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:18.665781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b42edf1e-77e9-4af5-b7cd-6537c3d8f12f tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.151837 Oct 19 13:50:18.666339 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 624/1228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:18 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:19.689077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:19.689691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:19.696316 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:19.696793 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:19.697225 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:19.697940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:19.698397 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:19.698844 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:19.824622 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:19.832794 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-52225ddc-9801-4a0b-a255-58fcf4444101 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.147611 Oct 19 13:50:19.833358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 605/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:19 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:20.855523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:20.856134 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:20.862734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:20.863213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:20.863645 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:20.864323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:20.864774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:20.865189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:20.990953 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:20.998435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-817723e9-2b8a-4a7d-9d8c-a3e8e27455ba tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.146939 Oct 19 13:50:20.999019 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 625/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:20 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:22.021247 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:22.028327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:22.028327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:22.028939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:22.029446 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:22.030234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:22.030784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:22.031279 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:22.034662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=85 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:22.164437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:22.172772 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-183407e8-c188-4dc3-951a-545d69f27632 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.154851 Oct 19 13:50:22.173331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 606/1231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:22 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:23.195725 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:23.196332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:23.198773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:23.203518 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:23.203993 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:23.204420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:23.205100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:23.205543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:23.205960 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:23.337018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:23.339213 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:23.345194 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ae63a410-d32e-493d-8533-25a46f93ed3a tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.153316 Oct 19 13:50:23.349841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 626/1232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:23 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:24.229297 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330db521-9212-4f13-ad5d-6556d932e0cc", "name": "network-vif-plugged", "status": "completed", "tag": "57ffa0a2-e01b-4cce-a9af-5ba10000df8c"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:24.234437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:24.235625 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:50:24.241231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:24.241777 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:24.242158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:24.254011 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] Creating event network-vif-plugged:57ffa0a2-e01b-4cce-a9af-5ba10000df8c for instance 330db521-9212-4f13-ad5d-6556d932e0cc on hv-cinder-86188 Oct 19 13:50:24.259226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-0164e518-4c8b-4190-b8f3-cea0cd786922 req-bb92feee-0bc3-4459-b94e-f2c2fd22cf80 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Oct 19 13:50:24.259729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 607/1233] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:50:24.368488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:24.369182 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:24.376224 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:24.376766 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:24.377129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:24.377818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:24.378263 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:24.378717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:24.509804 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:24.517680 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0d3b975e-6019-4aba-b608-ba9744c1f6ad tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.153197 Oct 19 13:50:24.518235 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 627/1234] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:24 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:25.541689 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:25.542391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:25.550072 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:25.550578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:25.551013 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:25.551696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:25.552150 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:25.552575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:25.679966 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:25.687517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-08a8d4a2-8683-4125-9a4e-8ce240172c1e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1360 microversion: 2.1 time: 0.150548 Oct 19 13:50:25.688696 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 608/1235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:25 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:26.711090 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:26.711641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:26.718539 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:26.719502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:26.719951 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:26.720637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:26.721094 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:26.721523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:26.846837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:50:26.854410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3366b2f0-d8c8-4b15-b9c4-4e3c3f7a9ea1 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1546 microversion: 2.1 time: 0.147655 Oct 19 13:50:26.855002 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 628/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:50:26 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:50:26.877180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:50:26.884197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:50:26.884197 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:26.884676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:26.885110 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:26.885790 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:26.886261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:26.886712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:26.963921 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-772da6a6-8509-44a5-b139-031ef6f67982 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090659 Oct 19 13:50:26.964508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 609/1237] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:50:26 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:50:27.907092 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330db521-9212-4f13-ad5d-6556d932e0cc", "tag": "57ffa0a2-e01b-4cce-a9af-5ba10000df8c"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:50:27.917818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:50:27.918309 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:50:27.918791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:50:27.930159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] Creating event network-changed:57ffa0a2-e01b-4cce-a9af-5ba10000df8c for instance 330db521-9212-4f13-ad5d-6556d932e0cc on hv-cinder-86188 Oct 19 13:50:27.935250 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-59352ac6-ae93-4f8d-92d0-1d035e36282c req-8294a873-9dc4-4ccb-ab26-feff00a40bb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032755 Oct 19 13:50:27.936037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 629/1238] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:00.358157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:00.358741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:00.363199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:00.364298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=15 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:00.372252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:00.374771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=17 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:00.376951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:00.377432 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:00.377880 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:00.378704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:00.379653 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:00.380069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:00.409747 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:51:00.502169 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:00.512657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:00.513127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:00.513550 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:00.525022 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] Creating event network-changed:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:51:00.530338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-d4640d42-bc7a-4417-930c-de38dfd4e332 req-22993d39-0122-4f90-9f32-1af384e73a42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168528 Oct 19 13:51:00.530939 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 630/1239] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:00.654720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-225a1613-42b4-4448-b279-526c483305fc tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 204 len: 0 microversion: 2.1 time: 0.299940 Oct 19 13:51:00.655604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 610/1240] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:51:00 2022] DELETE /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:51:00.665110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:00.666133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:00.672650 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:00.673135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:00.673747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:00.674481 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:00.675199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:00.675623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:00.815948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:00.824897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ab5e0c91-4e5f-4af4-984e-e6642263a2de tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1449 microversion: 2.1 time: 0.164396 Oct 19 13:51:00.825485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 631/1241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:00 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:01.848374 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:01.849236 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:01.855629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:01.856117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:01.856562 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:01.857258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:01.857714 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:01.858142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:02.071281 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:02.079002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-39790c9d-40ca-493e-944b-02055b25b083 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1449 microversion: 2.1 time: 0.235506 Oct 19 13:51:02.079571 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 611/1242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:01 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1449 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:03.102103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:03.103008 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:03.111010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:03.111625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:03.112016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:03.112722 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:03.113886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:03.114304 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:03.246639 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:03.253950 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-13d9dd2d-5e2a-47c0-bb38-60ae7e0bd56d tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1449 microversion: 2.1 time: 0.155701 Oct 19 13:51:03.254536 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 632/1243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:03 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:03.441663 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b407371-5bdc-4da7-be24-86e041c12194", "name": "network-vif-deleted", "tag": "b6c071c4-692d-4483-ade0-c45fb36f76af"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:03.451558 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:03.452995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:03.452995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:03.463169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] Creating event network-vif-deleted:b6c071c4-692d-4483-ade0-c45fb36f76af for instance 9b407371-5bdc-4da7-be24-86e041c12194 on hv-cinder-86188 Oct 19 13:51:03.468153 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-4e622159-0d65-432a-a3f1-af1b4c742dae req-3e17d1da-815e-42fe-84ea-77397c30f2c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Oct 19 13:51:03.468761 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 612/1244] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:04.276761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:04.277362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:04.284018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:04.288841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:04.288841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:04.288841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:04.288841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:04.289296 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:04.317929 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:04.318420 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:04.318877 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:04.319323 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lazy-loading 'fault' on Instance uuid 9b407371-5bdc-4da7-be24-86e041c12194 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:51:04.360424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f759f41b4d44a53a0b60443b4df0a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76384f17c9384958983b188d3617be7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:04.368364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-dcef505e-89f6-4abc-96b2-1b6ab4ebea7f tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 200 len: 1223 microversion: 2.1 time: 0.095640 Oct 19 13:51:04.368954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 633/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:04 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:05.392018 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:05.392711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] [instance: 9b407371-5bdc-4da7-be24-86e041c12194] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:05.399469 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:05.399941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:05.400368 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:05.401043 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:05.401491 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:05.401909 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:05.415157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] HTTP exception thrown: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Request method failure captured: Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 HTTP/1.1 Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_9mXKBEk5dV4irtET6l1RBVgqL7xpC8UfD7NiqQsrFq1S35Kevd13M8Pz2sobpaXSjgVdhgAVt7UpQ6_nW5fmuNzhvErJaWtzTpY-Nlo3VjhO1yYMCRaE68vPB6B60QanM7MvSmOdpR1tQR5a64RPLrj-I5FdcqRrqEloN_xiG7l9Y Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 76384f17c9384958983b188d3617be7e Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-TestShelveInstance-1631289803 Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:51:05.417041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76384f17c9384958983b188d3617be7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_76384f17c9384958983b188d3617be7e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/76384f17c9384958983b188d3617be7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76384f17c9384958983b188d3617be7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-TestShelveInstance-1631289803 Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 76384f17c9384958983b188d3617be7e Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-TestShelveInstance-1631289803 Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-TestShelveInstance-1631289803-project Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 8f759f41b4d44a53a0b60443b4df0a75 Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-TestShelveInstance-1631289803-project Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. Oct 19 13:51:05.418877 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '9b407371-5bdc-4da7-be24-86e041c12194'} Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:51:05.420172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. Oct 19 13:51:05.421932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:51:05.423434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Returning 404 to user: Instance 9b407371-5bdc-4da7-be24-86e041c12194 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:51:05.423434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0c76f418-8c86-4938-ab2d-846656bb6217 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194" status: 404 len: 111 microversion: 2.1 time: 0.031017 Oct 19 13:51:05.423434 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 613/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:05 2022] GET /compute/v2.1/servers/9b407371-5bdc-4da7-be24-86e041c12194 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:51:05.664721 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a7cc0ddf-325f-4560-9c90-eae681472db5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] Calling method '.version_select at 0x7fb41e3e9040>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:05.741644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a7cc0ddf-325f-4560-9c90-eae681472db5 tempest-TestShelveInstance-1631289803 tempest-TestShelveInstance-1631289803-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-500723674" status: 202 len: 0 microversion: 2.1 time: 0.080769 Oct 19 13:51:05.742227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 634/1247] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Oct 19 13:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-500723674 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:51:43.056079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:43.056697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:43.058999 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:43.059638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:43.064346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:43.064837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:43.065273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:43.065961 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:43.066418 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:43.066873 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:43.089523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1abfb70c-30e5-4de4-9e7f-bbdfd62f2306 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/ips" status: 200 len: 145 microversion: 2.1 time: 0.037954 Oct 19 13:51:43.090077 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 614/1248] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:51:43 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:44.645112 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=22 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:44.645948 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:44.650627 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78306e41-4cdd-4122-a143-a76b64f909ea"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:44.652976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:44.659729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:44.663894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:44.663894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:44.663894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:44.663894 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:44.664870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:45.405321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d7b395ea-097c-44c4-b7ab-f7240ac8f0ea tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761528 Oct 19 13:51:45.405918 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 635/1249] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:51:44 2022] POST /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:52.930360 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:52.932600 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:52.939691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.940169 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.940609 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:52.941286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.941773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.942192 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:52.971991 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fa8a0c6b-b02c-4bac-804a-b68a08179266 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Oct 19 13:51:52.972545 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 615/1250] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:51:52 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:52.984959 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:52.985544 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:52.991924 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.992445 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.992887 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:52.993568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.994020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.994439 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:53.024999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b25ca6af-bfe9-41a4-95d6-e77c075c4086 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea" status: 200 len: 194 microversion: 2.1 time: 0.044189 Oct 19 13:51:53.025576 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 636/1251] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 13:51:52 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:55.766390 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a55a1e3-10bd-4de9-9b8e-06205f231479"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:55.768707 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:55.776252 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:55.776731 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:55.777160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:55.777837 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:55.778286 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:55.778742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:56.404798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2d7ab51c-6c27-49ff-a9ab-4bcd6e698f9b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "POST /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642356 Oct 19 13:51:56.405407 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 616/1252] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:51:55 2022] POST /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:04.988286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:04.990568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:04.993696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:04.994367 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:04.999036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:04.999524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:04.999961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.000648 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:05.001105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:05.001530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.032734 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c2e958e7-e8fe-49f0-abd0-7cc2477194af tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048345 Oct 19 13:52:05.033276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 637/1253] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:52:04 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:05.168337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:05.168852 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:05.175024 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:05.175506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:05.175943 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.176629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:05.177084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:05.177518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.207779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bc9579de-53a8-429b-b0e5-fb6cdcc38e6e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea" status: 200 len: 194 microversion: 2.1 time: 0.044962 Oct 19 13:52:05.208337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 617/1254] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 13:52:05 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:05.219294 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:05.219792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:05.226435 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:05.226954 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:05.227390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.228078 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:05.228529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:05.228952 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:05.306965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lazy-loading 'services' on Instance uuid 330db521-9212-4f13-ad5d-6556d932e0cc {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:52:05.508802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3c820309-3c43-4b5c-8bd0-0ac2c69f93d3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea" status: 202 len: 0 microversion: 2.1 time: 0.293195 Oct 19 13:52:05.509321 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 638/1255] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:52:05 2022] DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/78306e41-4cdd-4122-a143-a76b64f909ea => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:52:07.683541 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:07.684025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:07.690406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:07.690913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:07.691345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:07.692023 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:07.692471 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:07.692894 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:07.720606 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dbb22731-58cd-4546-ad77-3879c0b378b3 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/0a55a1e3-10bd-4de9-9b8e-06205f231479" status: 200 len: 194 microversion: 2.1 time: 0.041649 Oct 19 13:52:07.721165 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 618/1256] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Oct 19 13:52:07 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/0a55a1e3-10bd-4de9-9b8e-06205f231479 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:07.733202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:07.733790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:07.739903 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:07.740384 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:07.740821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:07.741507 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:07.741962 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:07.742386 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:07.821865 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lazy-loading 'services' on Instance uuid 330db521-9212-4f13-ad5d-6556d932e0cc {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:52:08.051909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4ef53c59-ecc3-4f40-9b01-33f63bf27bc8 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/0a55a1e3-10bd-4de9-9b8e-06205f231479" status: 202 len: 0 microversion: 2.1 time: 0.323538 Oct 19 13:52:08.052583 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 639/1257] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:52:07 2022] DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments/0a55a1e3-10bd-4de9-9b8e-06205f231479 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:52:09.225319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:09.227665 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:09.234766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.235258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.235732 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.236462 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.236954 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.237381 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.266913 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2546cc3b-169c-4d96-b1b5-b6d58842db74 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045534 Oct 19 13:52:09.267459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 619/1258] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:52:09 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:52:09.381283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:09.383641 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:09.390167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.390675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.391110 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.391784 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.392232 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.392649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.421768 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8224d2c4-3f97-406e-8d02-5ba0a9077843 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044704 Oct 19 13:52:09.422301 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 640/1259] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:52:09 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:52:09.484464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:09.484993 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:09.490905 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.491387 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.491823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.492505 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.492958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.493382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.517443 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:52:09.765507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-a3ca5bc0-b2d3-400d-bda8-f3b9790f51f2 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 204 len: 0 microversion: 2.1 time: 0.284560 Oct 19 13:52:09.766102 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 620/1260] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:52:09 2022] DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:52:09.774327 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:09.774965 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:09.782733 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.783223 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.783657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.784377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:09.784830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:09.785256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:09.915763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:09.923606 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-767c902f-b88d-40f2-9cb6-476ef4784884 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1670 microversion: 2.1 time: 0.153199 Oct 19 13:52:09.924231 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 641/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:09 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:10.947365 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:10.948076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:10.954425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:10.954941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:10.955373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:10.956059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:10.956509 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:10.956933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:11.083762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:11.091906 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6756de09-84dc-4040-b55d-7e3817d81a76 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1670 microversion: 2.1 time: 0.148795 Oct 19 13:52:11.092464 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 621/1262] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:10 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:12.114802 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:12.115555 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:12.122637 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:12.123119 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:12.123554 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:12.124246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:12.124702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:12.125133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:12.251585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:12.259532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-17ed3ff8-81fe-42df-9dc4-176003fd4315 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1670 microversion: 2.1 time: 0.148611 Oct 19 13:52:12.260752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 642/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:12 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:12.887992 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330db521-9212-4f13-ad5d-6556d932e0cc", "name": "network-vif-deleted", "tag": "57ffa0a2-e01b-4cce-a9af-5ba10000df8c"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:12.899678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:12.900148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:12.900576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:12.913798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] Creating event network-vif-deleted:57ffa0a2-e01b-4cce-a9af-5ba10000df8c for instance 330db521-9212-4f13-ad5d-6556d932e0cc on hv-cinder-86188 Oct 19 13:52:12.919868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-b8839ed9-1cd5-4a30-a0a8-2df6ac7b8772 req-e99fb46b-d9aa-4021-aefd-29dadf63d788 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Oct 19 13:52:12.920591 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 622/1264] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:52:13.283517 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:13.284278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:13.290805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:13.291286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:13.292337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:13.293021 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:13.293467 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:13.293884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:13.326897 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:13.327388 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:13.327803 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:13.328418 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lazy-loading 'fault' on Instance uuid 330db521-9212-4f13-ad5d-6556d932e0cc {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:52:13.371729 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c996056bd0354124ae74e79abf2753a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723dfd3a60ee412b8569bb0a6081dc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:13.379777 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9e780fee-6422-4720-90e7-aa135fce384b tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 200 len: 1325 microversion: 2.1 time: 0.100377 Oct 19 13:52:13.380347 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 643/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:13 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 1325 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:14.404741 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:14.405711 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:14.412484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:14.412967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:14.413402 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:14.414096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:14.414580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:14.415005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:14.428208 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc HTTP/1.1 Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:52:14.429823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:14.431638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '330db521-9212-4f13-ad5d-6556d932e0cc'} Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:14.432759 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:14.434470 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:14.436367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:14.436367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b107685b-19f1-4b10-914d-e493afdc040e tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 404 len: 111 microversion: 2.1 time: 0.031873 Oct 19 13:52:14.436367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 623/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:14 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:14.440150 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-962f92a9-0b56-43fa-8680-29b77d702f60 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '.version_select at 0x7fb41e436dc0>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:14.521571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-962f92a9-0b56-43fa-8680-29b77d702f60 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54656529" status: 202 len: 0 microversion: 2.1 time: 0.085303 Oct 19 13:52:14.522138 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 644/1267] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Oct 19 13:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54656529 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:52:17.836027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:17.849287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:17.849287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:17.849287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:17.849287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:17.849721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:17.849721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:17.849721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:17.858931 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc HTTP/1.1 Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:52:17.860459 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.862170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '330db521-9212-4f13-ad5d-6556d932e0cc'} Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:17.863342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.865052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.866797 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:17.866797 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-302f35d3-7b26-432a-aedd-2634a2f71858 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 404 len: 111 microversion: 2.1 time: 0.029840 Oct 19 13:52:17.866797 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 624/1268] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:52:17 2022] DELETE /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:17.871782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:17.872456 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 330db521-9212-4f13-ad5d-6556d932e0cc] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:17.879424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:17.879905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:17.880358 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:17.881037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:17.881485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:17.881905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:17.895523 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc HTTP/1.1 Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:52:17.897130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.898925 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '330db521-9212-4f13-ad5d-6556d932e0cc'} Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:17.899783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. Oct 19 13:52:17.901171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:17.902436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 330db521-9212-4f13-ad5d-6556d932e0cc could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:17.902436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b767feea-9636-4748-a285-8e653a57fc85 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc" status: 404 len: 111 microversion: 2.1 time: 0.031983 Oct 19 13:52:17.902436 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 645/1269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:17 2022] GET /compute/v2.1/servers/330db521-9212-4f13-ad5d-6556d932e0cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:19.189271 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:19.189783 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:19.196155 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:19.196635 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:19.197070 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:19.198393 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:19.198884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:19.199311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:19.212455 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d HTTP/1.1 Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:52:19.213969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.215698 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '1f9ddd46-d529-42b2-946f-aa49eb37a00d'} Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:19.216734 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.218391 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.220053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:19.220053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-df393861-85c8-4687-9ba6-0c8aaaa2b734 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 404 len: 111 microversion: 2.1 time: 0.030048 Oct 19 13:52:19.220053 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 625/1270] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:52:19 2022] DELETE /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:19.223623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:19.224261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] [instance: 1f9ddd46-d529-42b2-946f-aa49eb37a00d] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:19.230583 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:19.231062 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:19.231495 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:19.232170 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:19.232617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:19.233033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:19.246425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] HTTP exception thrown: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Request method failure captured: Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d HTTP/1.1 Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjT_8_psqJwUzwPWx0l6OaFASBM1SDMLS-AGBP6EBN1n-c4sVTVk-rwjchZz35KcAB-iEjUaJBFdYg65crMwBjkpw8r1j2RrcRmrkZWe0Crmlx6FsJAJpxKW4WJTl8J-FgfC_a0JIK3HBp1gwkZfXAVWPeT8E-lvLEzilzJHHiZv9MbgQ Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:52:19.247919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_723dfd3a60ee412b8569bb0a6081dc7a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/723dfd3a60ee412b8569bb0a6081dc7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 723dfd3a60ee412b8569bb0a6081dc7a Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542004177 Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c996056bd0354124ae74e79abf2753a8 Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeTestJSON-1542004177-project Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.249696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '1f9ddd46-d529-42b2-946f-aa49eb37a00d'} Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:19.250714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. Oct 19 13:52:19.252302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:52:19.253730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] Returning 404 to user: Instance 1f9ddd46-d529-42b2-946f-aa49eb37a00d could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:19.253730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-de8bcc3c-e946-43ba-9a59-0ff757b29c44 tempest-AttachVolumeTestJSON-1542004177 tempest-AttachVolumeTestJSON-1542004177-project] 10.222.0.39 "GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d" status: 404 len: 111 microversion: 2.1 time: 0.029455 Oct 19 13:52:19.253730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 646/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:19 2022] GET /compute/v2.1/servers/1f9ddd46-d529-42b2-946f-aa49eb37a00d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:29.733245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:29.733980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:29.854019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: .version_select at 0x7fb41e777940>, body: {"keypair": {"name": "tempest-keypair-448800261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxGv4F5bvrlGLY/NCYfJiL7ZhzH0clOPRJSCaGmDkQYsBnLKRLkvAHVOQbFJKDXWyPRoIPcdGOqIQRBvPWdMj4S6kik10RbDP94rCaqSagsmvtHZIpg1WtL2S1HIoWDPA=="}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:29.875315 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:52:29.879154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:52:29.893183 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [60b7d02a-e19a-4dd4-8a90-9573774caf53] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:52:30.900641 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [60b7d02a-e19a-4dd4-8a90-9573774caf53] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 41598. Oct 19 13:52:30.961955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-e7d1a776-73ef-44f7-95ed-5b8a688c5737 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.233895 Oct 19 13:52:30.962575 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 626/1272] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:52:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:52:33.080301 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1780364597", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f9c3265-aa51-43a0-aa8a-6d27e1b19059"}], "security_groups": [{"name": "tempest-securitygroup--1332211364"}], "key_name": "tempest-keypair-448800261", "user_data": "}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:33.100032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:33.100718 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:33.188255 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] validate_networks() for [('5f9c3265-aa51-43a0-aa8a-6d27e1b19059', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:52:33.594761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:52:33.595187 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:52:33.595661 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:52:33.596071 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:52:33.596483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:52:33.605728 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:33.606200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:33.606667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:33.607382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:33.607832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:33.608246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:33.625042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:52:33.628973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:52:33.639834 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:52:33.642096 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:52:33.767750 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-63ee8d16-58ba-4022-ba91-5f91da5c4f73 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691921 Oct 19 13:52:33.768385 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 647/1273] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:52:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:52:33.780243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c5f6a5be-3bfe-4a20-baf5-ea1cb057a41d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:33.780862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c5f6a5be-3bfe-4a20-baf5-ea1cb057a41d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:33.834574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c5f6a5be-3bfe-4a20-baf5-ea1cb057a41d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:33.841310 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c5f6a5be-3bfe-4a20-baf5-ea1cb057a41d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1241 microversion: 2.1 time: 0.065723 Oct 19 13:52:33.843179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 627/1274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:33 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:34.864851 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:34.865459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:34.872780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:34.873260 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:34.873690 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:34.874369 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:34.874854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:34.875277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:34.952782 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:34.960915 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-ac04a54a-f6d2-4105-8ec1-6a5c1b94d655 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1245 microversion: 2.1 time: 0.100422 Oct 19 13:52:34.961664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 648/1275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:34 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:35.984687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:35.985433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:35.995223 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:35.996620 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:35.997299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:35.998221 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:35.998721 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:35.999154 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:36.074522 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:36.084939 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5faa9e78-3082-4632-bf70-d4a5fd09039a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1311 microversion: 2.1 time: 0.104999 Oct 19 13:52:36.097687 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 628/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:35 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:37.108245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:37.108856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:37.115601 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.116083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.117860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.117860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.117860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.118228 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.249289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:37.257248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-63041f07-1f03-464c-a6e0-2ec1c08a6eb1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.152890 Oct 19 13:52:37.257752 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 649/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:37 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:37.516977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f33c077-46ba-4d09-96f4-5af851f1bd97", "tag": "82a548f2-0eb4-4449-b9e9-d8ebc29dc406"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:37.526838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.527311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.527737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.539604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] Creating event network-changed:82a548f2-0eb4-4449-b9e9-d8ebc29dc406 for instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 on hv-cinder-86188 Oct 19 13:52:37.544840 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-52fccad2-289c-4719-89a9-c1a26c0310c6 req-f856448c-5ca4-4b7a-bfb7-52689f41f0fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031639 Oct 19 13:52:37.546656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 629/1278] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:38.281779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:38.282396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:38.288767 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:38.289279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:38.289714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:38.290399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:38.290890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:38.291317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:38.417932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:38.425610 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-339aed6e-eb4e-4125-a377-d08fe30098fa tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.148616 Oct 19 13:52:38.426171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 650/1279] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:38 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:39.450345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:39.451095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:39.457334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:39.457815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:39.458251 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:39.458976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:39.459433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:39.459858 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:39.585034 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:39.592487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-075d8a5f-8a8c-42a7-a652-f2a206944191 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.147413 Oct 19 13:52:39.593040 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 630/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:39 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:40.615528 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:40.616148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:40.622793 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:40.623278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:40.623714 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:40.624400 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:40.624853 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:40.625281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:40.752772 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:40.760287 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fc90cc9d-057a-4e4b-bbde-176c8971ea4c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.148687 Oct 19 13:52:40.760849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 651/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:40 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:41.783995 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:41.784599 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:41.786740 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:52:41.786878 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Wed Oct 19 13:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 (ip 10.222.0.39) !!! Oct 19 13:52:41.794030 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:41.794524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:41.794955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:41.795672 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:41.796117 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:41.796532 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:41.922914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:41.930595 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9696ddd6-40d9-4433-8a92-39556a747781 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.150398 Oct 19 13:52:41.931168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 631/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:41 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:42.953124 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:42.953763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:42.960174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:42.960649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:42.961099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:42.961778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:42.962218 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:42.962666 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:43.092681 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:43.100273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-83ba2615-96b4-421e-9b76-8f27f4035c4e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.150995 Oct 19 13:52:43.102142 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 652/1283] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:42 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:44.124870 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:44.125482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:44.127359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:44.132106 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:44.132583 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:44.133020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:44.133704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:44.134157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:44.134604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:44.262699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:44.270276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c9cdc63d-bce8-4ba2-ba28-db3390f588c0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.150079 Oct 19 13:52:44.273308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 632/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:44 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:44.892298 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:44.893039 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:44.952900 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f33c077-46ba-4d09-96f4-5af851f1bd97", "name": "network-vif-plugged", "status": "completed", "tag": "82a548f2-0eb4-4449-b9e9-d8ebc29dc406"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:44.962732 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:44.963202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:44.963628 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:44.976103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] Creating event network-vif-plugged:82a548f2-0eb4-4449-b9e9-d8ebc29dc406 for instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 on hv-cinder-86188 Oct 19 13:52:44.981461 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-fa96c48d-8c53-4a5d-997b-31309e3016e4 req-684352fe-7791-4002-971b-49b01b01a761 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093443 Oct 19 13:52:44.982237 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 653/1285] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:45.292977 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:45.293847 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:45.300260 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.300738 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.301168 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:45.301856 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.302301 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.302749 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:45.429392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:45.437504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9aff3b85-c10f-4c89-88fc-a746c70422c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.148380 Oct 19 13:52:45.438065 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 633/1286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:45 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:46.461840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:46.462559 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:46.470015 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:46.470485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:46.470936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:46.471609 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:46.472056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:46.472473 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:46.596790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:46.605202 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-69aedf9f-b28f-4392-8300-90abfbfe8173 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1367 microversion: 2.1 time: 0.147712 Oct 19 13:52:46.605417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 654/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:46 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:47.626884 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:47.627495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:47.633868 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:47.634343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:47.634809 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:47.635487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:47.635932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:47.636346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:47.762924 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:47.770602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-38461cf6-7dd1-457c-b3b1-363938f14f55 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1558 microversion: 2.1 time: 0.147576 Oct 19 13:52:47.771167 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 634/1288] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:47 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:52:47.793198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:47.793717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:47.800293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:47.800771 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:47.801209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:47.801891 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:47.802338 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:47.802835 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:47.884919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c02951ba-24d7-4a44-b37d-033c79ea0e82 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095535 Oct 19 13:52:47.885634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 655/1289] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:52:47 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:49.075352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f33c077-46ba-4d09-96f4-5af851f1bd97", "tag": "82a548f2-0eb4-4449-b9e9-d8ebc29dc406"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:49.085608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:49.088416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:49.088416 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:49.097508 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] Creating event network-changed:82a548f2-0eb4-4449-b9e9-d8ebc29dc406 for instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 on hv-cinder-86188 Oct 19 13:52:49.102484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-19093aab-b5fb-4774-ad39-37699a3fc235 req-a2b03efa-d98f-4dc5-9c5f-5bcac0403309 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031420 Oct 19 13:52:49.103087 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 635/1290] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:04.217788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:04.218553 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=44 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:04.223297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:04.223785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:04.229640 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:04.230115 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:04.230562 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:04.231273 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:04.231720 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:04.232630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:04.256238 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-b098eba0-a95c-404e-9f92-1687eb575fd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/ips" status: 200 len: 151 microversion: 2.1 time: 0.040523 Oct 19 13:54:04.256695 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 656/1291] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:54:04 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:06.960264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:06.961012 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=40 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:06.965678 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9cbb2d-1f3b-4946-ae89-c759cab2805f"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:06.968817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:06.983946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:06.983946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:06.983946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:06.983946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:06.984366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:06.984366 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:07.709557 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7622b642-d965-4f67-ae7e-6b66642dc7c9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.751046 Oct 19 13:54:07.710149 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 636/1292] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:54:06 2022] POST /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:15.238813 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: .version_select at 0x7fb41e36b5e0>, body: {"keypair": {"name": "tempest-keypair-742886418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHpoxkpX+tJcwW3jPfhCuW3PbTvM2KRuZPvU1sc9YVVxEGrFj1WnAJdJPB1fa5UDh0zo4/eXi0KOIsCXcSMJKCqOhLHLsVk1Fy3hTGEnYYnRZhoFjOATEQHO9dbBE3jRQ=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:15.255374 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:54:15.259204 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:54:15.271199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [9dcdd224-855a-4504-9869-4103da45d112] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:54:16.278636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO oslo.messaging._drivers.impl_rabbit [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [9dcdd224-855a-4504-9869-4103da45d112] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 41762. Oct 19 13:54:16.347233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-45128fae-743d-4946-a519-023a5da7a242 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.112843 Oct 19 13:54:16.347862 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 657/1293] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:54:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:18.410317 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:18.411108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:18.415612 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1272038337", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f9c3265-aa51-43a0-aa8a-6d27e1b19059"}], "security_groups": [{"name": "tempest-securitygroup--897838977"}], "key_name": "tempest-keypair-742886418", "user_data": "}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:18.515914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] validate_networks() for [('5f9c3265-aa51-43a0-aa8a-6d27e1b19059', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:54:18.915774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:54:18.916205 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:54:18.916684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:54:18.917098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:54:18.917520 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:54:18.927527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:18.928015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:18.928457 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:18.929190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:18.929647 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:18.930098 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:18.946879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:54:18.950935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:54:18.962062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:54:18.964523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:54:19.086406 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-80a67837-80a9-4881-ae1f-04a24aa6f497 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677365 Oct 19 13:54:19.087015 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 637/1294] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:54:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:54:19.098399 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9a0e479f-e960-4f66-b7be-a620ef32c264 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:19.099132 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9a0e479f-e960-4f66-b7be-a620ef32c264 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:19.153927 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-9a0e479f-e960-4f66-b7be-a620ef32c264 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:19.161405 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9a0e479f-e960-4f66-b7be-a620ef32c264 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1241 microversion: 2.1 time: 0.066777 Oct 19 13:54:19.161574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 658/1295] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:19 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:20.184719 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:20.185332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:20.193005 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:20.193478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:20.193917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:20.194636 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:20.195092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:20.195521 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:20.255141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:20.265727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-96b6cfc8-8882-45b3-9446-675d11659365 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1237 microversion: 2.1 time: 0.082457 Oct 19 13:54:20.265727 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 638/1296] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:20 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:21.287500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:21.288093 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:21.294190 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:21.294715 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:21.295152 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:21.295838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:21.296289 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:21.296716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:21.357425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:21.365219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e5eb3a85-fd22-4dc6-b57b-2d92d355d457 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1299 microversion: 2.1 time: 0.082376 Oct 19 13:54:21.369189 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 659/1297] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:21 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:54:22.388760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:22.389303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:22.396864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:22.397373 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:22.397807 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:22.398615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:22.399055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:22.399478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:22.753372 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:22.761244 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-49acf559-ef8b-48cb-b395-5f488577808c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.376497 Oct 19 13:54:22.761818 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 639/1298] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:22 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:22.858994 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23264d0-26c1-48f3-830a-d2d480f0480f", "tag": "3f8882e8-a07f-438a-9dd3-71c0171b8301"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:22.868938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:22.869409 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:22.869840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:22.880911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] Creating event network-changed:3f8882e8-a07f-438a-9dd3-71c0171b8301 for instance f23264d0-26c1-48f3-830a-d2d480f0480f on hv-cinder-86188 Oct 19 13:54:22.885902 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-b9b685bd-e214-4a4e-8e36-1706c3a77c0b req-193ad438-ce1c-41af-81ee-de21276fec33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Oct 19 13:54:22.886798 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 660/1299] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:23.784234 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:23.784783 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:23.791224 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:23.791699 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:23.792162 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:23.792841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:23.793293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:23.793715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:23.917820 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:23.925956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2db447cd-39db-448e-9177-70028005d2c7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.145797 Oct 19 13:54:23.926576 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 640/1300] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:23 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:54:24.950160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:24.950808 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:24.957557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:24.958038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:24.958468 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:24.959167 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:24.959617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:24.960036 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.087500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:25.095105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5917d587-759c-4471-8b6b-83b8f8da843a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.149645 Oct 19 13:54:25.095667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 661/1301] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:24 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:54:26.117334 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:26.117946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:26.124329 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:26.124808 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:26.125241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:26.125925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:26.126378 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:26.126831 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:26.259284 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:26.267028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-8d9d4059-311a-427a-a473-a479977eebca tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.153508 Oct 19 13:54:26.268196 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 641/1302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:26 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:27.289781 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:27.290394 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:27.297069 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:27.297552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:27.297990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:27.298744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:27.299195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:27.299616 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:27.426225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:27.433774 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-33df4228-2448-493f-871e-546a2b98c6d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.147910 Oct 19 13:54:27.434329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 662/1303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:27 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:28.457187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:28.457799 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:28.464179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.464658 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.465094 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.465780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.466231 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.466690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.590932 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:28.598958 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9e937969-82b4-4b9b-b7fc-0e25f948f04f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.146222 Oct 19 13:54:28.599515 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 642/1304] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:28 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:29.264117 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23264d0-26c1-48f3-830a-d2d480f0480f", "name": "network-vif-plugged", "status": "completed", "tag": "3f8882e8-a07f-438a-9dd3-71c0171b8301"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:29.269544 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:29.274837 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:29.275313 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:29.275746 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:29.287361 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] Creating event network-vif-plugged:3f8882e8-a07f-438a-9dd3-71c0171b8301 for instance f23264d0-26c1-48f3-830a-d2d480f0480f on hv-cinder-86188 Oct 19 13:54:29.292667 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-e54a1f15-35c8-4368-9946-2c59a823c464 req-e375de9e-45b4-4f2e-9da7-c99ce704f400 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Oct 19 13:54:29.295440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 663/1305] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:29.622523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:29.629980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:29.629980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:29.629980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:29.631544 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:29.632027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:29.632461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:29.633148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:29.633601 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:29.634025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:29.771886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:29.780097 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-2de972ce-b9bb-49c1-a8a8-ce722aa68bae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.161451 Oct 19 13:54:29.780662 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 643/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:29 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:30.805565 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:30.806262 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:30.812413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.812885 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.813312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.813984 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.814432 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.814873 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.941311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:30.949207 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-40805d09-0585-4c9c-964c-7cac5d416991 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1366 microversion: 2.1 time: 0.148627 Oct 19 13:54:30.949763 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 664/1307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:30 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:31.971725 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:31.972330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:31.978715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.979190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.979616 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.980292 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.980739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.981160 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:32.105478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:32.113478 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-19f5b18d-f088-4612-9ab7-052233b3fc2c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1556 microversion: 2.1 time: 0.145663 Oct 19 13:54:32.114036 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 644/1308] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:31 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:32.136013 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:32.136515 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:32.145219 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:32.145580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:32.146048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:32.146778 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:32.147233 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:32.147656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:32.227496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-291e66a6-6e05-4189-8940-f8abd7593a22 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095258 Oct 19 13:54:32.228088 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 665/1309] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:54:32 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:33.243108 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23264d0-26c1-48f3-830a-d2d480f0480f", "tag": "3f8882e8-a07f-438a-9dd3-71c0171b8301"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:33.252602 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:33.253069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:33.253496 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:33.264184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] Creating event network-changed:3f8882e8-a07f-438a-9dd3-71c0171b8301 for instance f23264d0-26c1-48f3-830a-d2d480f0480f on hv-cinder-86188 Oct 19 13:54:33.269120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-5bfc49e2-d8df-4ac8-9b08-a85c124dcb69 req-efe67c74-530b-4673-9d79-624a9464736b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119293 Oct 19 13:54:33.269692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 645/1310] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:00.012311 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:00.013500 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=36 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:00.014270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:56:00.014410 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Wed Oct 19 13:56:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/ips (ip 10.222.0.39) !!! Oct 19 13:56:00.026006 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:00.026651 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:00.033000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.033483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.033919 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.034630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.035086 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.035503 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.059702 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-704cd9cd-2c1b-4691-bf87-df165231b148 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/ips" status: 200 len: 150 microversion: 2.1 time: 0.049557 Oct 19 13:56:00.060195 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 666/1311] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:56:00 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:00.070540 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:00.071888 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=46 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:00.076345 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9cbb2d-1f3b-4946-ae89-c759cab2805f"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:00.078821 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:00.084836 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.085313 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.085748 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.086426 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.086940 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.087363 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.287346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: POST /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/os-volume_attachments HTTP/1.1 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 74 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:56:00.289047 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {"volumeAttachment": {"volumeId": "6c9cbb2d-1f3b-4946-ae89-c759cab2805f"}} Oct 19 13:56:00.290907 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'server_id': 'f23264d0-26c1-48f3-830a-d2d480f0480f', 'body': {'volumeAttachment': {'volumeId': '6c9cbb2d-1f3b-4946-ae89-c759cab2805f'}}} Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:56:00.292129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:00.293795 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 400 to user: Invalid volume: volume 6c9cbb2d-1f3b-4946-ae89-c759cab2805f is already attached to instances: 6f33c077-46ba-4d09-96f4-5af851f1bd97 {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0f2572cd-a844-4127-a4d8-570b158e8253 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.222149 Oct 19 13:56:00.295468 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 646/1312] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:56:00 2022] POST /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:56:00.299472 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:00.299995 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:00.306669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.307141 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.307567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.308243 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.308688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.309105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.333502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:56:00.577199 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f0e6be85-b78d-404f-9df5-865c8064fa72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 204 len: 0 microversion: 2.1 time: 0.281443 Oct 19 13:56:00.577773 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 667/1313] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:00 2022] DELETE /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:56:00.585988 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:00.586664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:00.593020 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.593506 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.593947 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.594676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:00.595129 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:00.595560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:00.726739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:00.734332 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ffe96bb7-e24c-4d70-8022-8dc5e5e5fa1f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1681 microversion: 2.1 time: 0.152416 Oct 19 13:56:00.734920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 647/1314] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:00 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:01.757838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:01.759121 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:01.765547 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:01.766018 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:01.766476 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:01.767173 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:01.767618 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:01.768032 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:01.957315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:01.965875 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3770294b-dfe7-4a85-9233-b53aa25da00d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1681 microversion: 2.1 time: 0.212312 Oct 19 13:56:01.966442 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 668/1315] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:01 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:02.989555 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:02.990779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:02.998096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:02.998615 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:02.999049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:02.999941 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:03.000395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:03.000817 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:03.068692 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:03.076866 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5f4a693f-3b70-4c2a-ad3f-9422275015f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1614 microversion: 2.1 time: 0.091713 Oct 19 13:56:03.077424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 648/1316] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:02 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:56:03.315831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23264d0-26c1-48f3-830a-d2d480f0480f", "name": "network-vif-deleted", "tag": "3f8882e8-a07f-438a-9dd3-71c0171b8301"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:03.326312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:03.327037 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:03.327788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:03.340847 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] Creating event network-vif-deleted:3f8882e8-a07f-438a-9dd3-71c0171b8301 for instance f23264d0-26c1-48f3-830a-d2d480f0480f on hv-cinder-86188 Oct 19 13:56:03.346656 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-97928aee-e2cc-4990-9ab4-08cd6bce6819 req-98ff0307-5bf0-4aeb-a22a-51abe0570678 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117117 Oct 19 13:56:03.347573 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 669/1317] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:04.100718 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:04.106190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:04.109841 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:04.110346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:04.110998 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:04.111704 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:04.112303 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:04.112872 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:04.146096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:04.146096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:04.146096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:04.146096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'fault' on Instance uuid f23264d0-26c1-48f3-830a-d2d480f0480f {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:56:04.188640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:04.197311 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-74d2c574-d3aa-40f0-84c8-4405ce5d6946 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 200 len: 1331 microversion: 2.1 time: 0.100361 Oct 19 13:56:04.203695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 649/1318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:04 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:05.221578 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:05.222268 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:05.229355 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:05.229830 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:05.230261 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:05.230975 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:05.231424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:05.231840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:05.245247 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f HTTP/1.1 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:56:05.246856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 13:56:05.248617 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'f23264d0-26c1-48f3-830a-d2d480f0480f'} Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:05.249590 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 13:56:05.251246 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:05.252859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:05.252859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-36ffbd1d-f588-48f2-a6e4-a24232fa167e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 404 len: 111 microversion: 2.1 time: 0.030834 Oct 19 13:56:05.252859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 670/1319] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:05 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:05.257246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3f91cb14-e901-4b5e-aff1-0cbd14e704f6 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '.version_select at 0x7fb41e254f70>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:05.338972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3f91cb14-e901-4b5e-aff1-0cbd14e704f6 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742886418" status: 202 len: 0 microversion: 2.1 time: 0.085799 Oct 19 13:56:05.339556 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 650/1320] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:56:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742886418 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:56:06.105526 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:06.106023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:06.111975 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:06.112454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:06.112890 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:06.113574 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:06.114027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:06.114449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:06.193496 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'services' on Instance uuid 6f33c077-46ba-4d09-96f4-5af851f1bd97 {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:56:06.342100 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-140a366e-7777-4576-94fc-a8b748b16ae9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments/6c9cbb2d-1f3b-4946-ae89-c759cab2805f" status: 202 len: 0 microversion: 2.1 time: 0.240318 Oct 19 13:56:06.342762 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 671/1321] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:56:06 2022] DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments/6c9cbb2d-1f3b-4946-ae89-c759cab2805f => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:56:06.351559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:06.353750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:06.360543 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:06.361059 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:06.361503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:06.362201 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:06.362690 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:06.363120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:06.393196 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1f69048b-a0a0-4160-b32b-55a1f83ec5a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Oct 19 13:56:06.393756 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 651/1322] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:56:06 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:07.406585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:07.409023 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:07.415876 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:07.416428 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:07.416955 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:07.417713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:07.418392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:07.418716 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:07.448196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c2cd2cf2-db40-4e05-ad8c-4adedaae10d4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Oct 19 13:56:07.448744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 672/1323] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:56:07 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:08.462026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:08.464346 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:08.470876 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.471379 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.471796 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:08.472482 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.472938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.473364 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:08.503228 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-48f0c220-f8fe-4f21-90c3-3b0ea4d69620 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046418 Oct 19 13:56:08.503774 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 652/1324] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:56:08 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:56:08.569848 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:08.570381 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:08.577390 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.577860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.582670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:08.582670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.582670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.582670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:08.606821 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:56:08.926140 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-0a5dbea6-1c01-4015-9e37-404c98e0d4b9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 204 len: 0 microversion: 2.1 time: 0.359815 Oct 19 13:56:08.926842 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 673/1325] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:08 2022] DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:56:08.935474 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:08.936158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:08.942080 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.942611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.943054 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:08.943747 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:08.944206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:08.944637 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:09.072342 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:09.080062 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1993c362-7213-4b65-8246-b33841f85a1e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1683 microversion: 2.1 time: 0.148370 Oct 19 13:56:09.080810 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 653/1326] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:08 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:10.105130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:10.105845 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:10.112363 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:10.112841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:10.113269 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:10.113983 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:10.114434 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:10.114881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:10.245789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:10.253596 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-39b5e349-68c4-4574-bf98-d47c4e6bcfd8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1683 microversion: 2.1 time: 0.153268 Oct 19 13:56:10.254160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 674/1327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:10 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:11.277550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:11.278195 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:11.284800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:11.285261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:11.285695 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:11.286384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:11.286855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:11.287282 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:11.417229 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:11.425123 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-7b0c8878-5d6a-4d13-907b-5699c046bfbf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1683 microversion: 2.1 time: 0.152339 Oct 19 13:56:11.425686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 654/1328] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:11 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:11.720691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f33c077-46ba-4d09-96f4-5af851f1bd97", "name": "network-vif-deleted", "tag": "82a548f2-0eb4-4449-b9e9-d8ebc29dc406"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:11.732585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:11.732585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:11.732585 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:11.742859 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] Creating event network-vif-deleted:82a548f2-0eb4-4449-b9e9-d8ebc29dc406 for instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 on hv-cinder-86188 Oct 19 13:56:11.748738 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-a7a99429-48a7-4c3d-9f96-b036c53ac3be req-ff3a898c-eac5-460d-b300-30f3b90ab8b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031954 Oct 19 13:56:11.749329 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 675/1329] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:12.449813 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:12.450620 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:12.457095 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:12.457638 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:12.458141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:12.458914 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:12.459430 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:12.459917 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:12.496083 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:12.501175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:12.501175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:12.501175 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'fault' on Instance uuid 6f33c077-46ba-4d09-96f4-5af851f1bd97 {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:56:12.542405 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:12.550561 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c44e446d-98b9-49bf-a43a-5af0a3b7b80d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 200 len: 1331 microversion: 2.1 time: 0.105110 Oct 19 13:56:12.551461 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 655/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:12 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:13.578597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:13.579254 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:13.585946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:13.586454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:13.586911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:13.587618 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:13.588068 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:13.588487 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:13.601465 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 HTTP/1.1 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:56:13.603081 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 13:56:13.604827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '6f33c077-46ba-4d09-96f4-5af851f1bd97'} Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:13.605814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 13:56:13.607575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:56:13.609317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:13.609317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f86d4c87-e54a-45e7-9a4d-67936a6ea78c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 404 len: 111 microversion: 2.1 time: 0.030189 Oct 19 13:56:13.609317 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 676/1331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:13 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:13.613287 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-93819430-01b1-44e9-8c07-c7478c2b5c07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '.version_select at 0x7fb41fd12b80>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:13.686180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-93819430-01b1-44e9-8c07-c7478c2b5c07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448800261" status: 202 len: 0 microversion: 2.1 time: 0.076628 Oct 19 13:56:13.686769 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 656/1332] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448800261 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:56:14.621997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1f53fd9e-496d-4c01-a4eb-a128bf30c917 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: .version_select at 0x7fb41e3e9ee0>, body: {"keypair": {"name": "tempest-keypair-571171769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbkIIzQ/mv+YTIhpPRe1zIi4lgNcSFUzbiEmDjNuWBNk93XYmI48X5cl5ygBQUaob8JWBUVO2i/MsCdzcwFqPUSTZtp8ryNzmZ+UZ1t5dCEKk8dgfduLMk7SJdETUPhRA=="}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:14.637712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-1f53fd9e-496d-4c01-a4eb-a128bf30c917 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:56:14.641540 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-1f53fd9e-496d-4c01-a4eb-a128bf30c917 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:56:14.719970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1f53fd9e-496d-4c01-a4eb-a128bf30c917 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101887 Oct 19 13:56:14.720561 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 677/1333] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:56:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:16.899547 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1263200039", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f9c3265-aa51-43a0-aa8a-6d27e1b19059"}], "security_groups": [{"name": "tempest-securitygroup--2051812459"}], "key_name": "tempest-keypair-571171769", "user_data": "}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:17.008458 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.network.neutron [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] validate_networks() for [('5f9c3265-aa51-43a0-aa8a-6d27e1b19059', None, None, None, None, None)] {{(pid=125749) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:56:17.602937 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:56:17.603972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image limits 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:56:17.604454 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:56:17.604864 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image pref 0:0:0 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:56:17.605276 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.virt.hardware [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125749) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:56:17.614439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:17.614946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:17.615384 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:17.616404 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:17.616860 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:17.617285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:17.634073 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:56:17.638483 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:56:17.649633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Going to run 1 instances... {{(pid=125749) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:56:17.652549 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125749) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:56:17.779776 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-1e9d701e-21cd-445d-81e2-aa46070ef8c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.885286 Oct 19 13:56:17.780552 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 657/1334] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:56:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:56:17.792976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4b5f1830-d63b-41d7-a704-4ad855ab0d92 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:17.793707 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4b5f1830-d63b-41d7-a704-4ad855ab0d92 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:17.851175 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4b5f1830-d63b-41d7-a704-4ad855ab0d92 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:17.858396 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4b5f1830-d63b-41d7-a704-4ad855ab0d92 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1241 microversion: 2.1 time: 0.070532 Oct 19 13:56:17.858980 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 678/1335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:17 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:18.882789 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:18.883539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:18.890388 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:18.890890 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:18.891319 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:18.892002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:18.892517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:18.893122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:18.967055 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:18.971064 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-776119bf-e98e-40d0-8325-192511df5948 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1245 microversion: 2.1 time: 0.093620 Oct 19 13:56:18.971656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 658/1336] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:18 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:19.995840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:19.997482 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:20.004542 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:20.005160 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:20.005603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:20.006305 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:20.006790 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:20.007216 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:20.068999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:20.076936 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-4463a9a9-4dc6-4626-9a57-13143a04caeb tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1301 microversion: 2.1 time: 0.085508 Oct 19 13:56:20.077743 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 679/1337] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:19 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:21.100159 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:21.100775 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:21.107182 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:21.107668 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:21.108112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:21.108801 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:21.109253 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:21.109682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:21.321715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:21.329956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-0d035186-5f03-42bb-89f3-776ade841563 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.233720 Oct 19 13:56:21.330538 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 659/1338] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:21 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:21.760106 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ddd878-836f-4de7-949f-d8005bda2dbb", "tag": "b5774147-4654-4ac3-add1-fec0c81ed2d8"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:21.769814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:21.770365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:21.771024 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:21.783084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] Creating event network-changed:b5774147-4654-4ac3-add1-fec0c81ed2d8 for instance 91ddd878-836f-4de7-949f-d8005bda2dbb on hv-cinder-86188 Oct 19 13:56:21.788083 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-0081ed38-2390-4e31-b5cb-245879636d88 req-49c62d42-de15-4c53-b408-1931b8356702 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Oct 19 13:56:21.788677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 680/1339] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:56:22.353079 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:22.353686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:22.360019 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:22.360504 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:22.360935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:22.361614 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:22.362069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:22.362489 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:22.567289 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:22.574933 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-bec96cd5-aec5-4de0-a0fe-199ea705e944 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.225678 Oct 19 13:56:22.575533 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 660/1340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:22 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:23.600087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:23.600833 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:23.607454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:23.607931 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:23.608364 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:23.609038 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:23.609488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:23.609906 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:23.734048 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:23.741581 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-62fc1db8-3594-4bf2-96a1-bc2066f991c8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.146149 Oct 19 13:56:23.742129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 681/1341] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:23 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:24.765849 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:24.766453 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:24.773031 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:24.773510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:24.773938 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:24.774639 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:24.775093 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:24.775518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:24.905925 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:24.913542 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-50d6344f-6f8a-46c2-8739-9cbb0d18af56 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.151586 Oct 19 13:56:24.914099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 661/1342] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:24 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:25.936393 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:25.936997 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:25.943440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:25.946349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:25.946349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:25.946349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:25.946349 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:25.946805 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:26.079248 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:26.086911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8457b950-568b-4c25-88c3-e2cf7da29210 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.154428 Oct 19 13:56:26.087469 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 682/1343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:25 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:27.110090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:27.110733 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:27.117146 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:27.117629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:27.118066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:27.118771 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:27.119226 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:27.119651 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:27.243670 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:27.251241 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-eafdd7db-ed91-49d2-9538-77b2d7599200 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.144986 Oct 19 13:56:27.251804 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 662/1344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:27 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:27.811625 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ddd878-836f-4de7-949f-d8005bda2dbb", "name": "network-vif-plugged", "status": "completed", "tag": "b5774147-4654-4ac3-add1-fec0c81ed2d8"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:27.821017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:27.823973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:27.823973 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:27.833416 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] Creating event network-vif-plugged:b5774147-4654-4ac3-add1-fec0c81ed2d8 for instance 91ddd878-836f-4de7-949f-d8005bda2dbb on hv-cinder-86188 Oct 19 13:56:27.838303 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-56d516d0-4ae1-4d0a-9e3c-7a2fa8a51d9c req-89fae066-d34a-4fdc-8fb1-8f3851e9eb76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Oct 19 13:56:27.838970 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 683/1345] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:28.274180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:28.274815 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:28.276628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=2 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:28.277343 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:28.282441 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:28.282979 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:28.283409 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:28.284092 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:28.284534 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:28.284952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:28.414608 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:28.422685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d85257b9-e473-4178-b915-4f919787eb85 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.152700 Oct 19 13:56:28.423243 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 663/1346] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:28 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:29.443159 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:29.447881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:29.448584 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:29.455282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:29.456446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:29.456446 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:29.456840 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:29.457295 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:29.457712 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:29.583350 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:29.586753 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:29.591164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d64a74a9-cc1c-4681-b196-54174b405bed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1367 microversion: 2.1 time: 0.148957 Oct 19 13:56:29.591723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 684/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:29 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:30.616131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:30.616742 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:30.619017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.623686 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.624163 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.624593 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.625270 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.625715 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.626131 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.630009 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=97 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.756425 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:30.764766 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b345faf1-4e17-4401-8cdd-d71035359d7b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1557 microversion: 2.1 time: 0.152478 Oct 19 13:56:30.765331 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 664/1348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:30 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:30.787366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:30.787846 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:30.790067 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.795047 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.800143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.800143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.800143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.800143 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.800552 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.873488 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-84c88721-e4c9-49f4-b1b4-f58c9120528c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090343 Oct 19 13:56:30.874061 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 685/1349] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:56:30 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:31.811339 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ddd878-836f-4de7-949f-d8005bda2dbb", "tag": "b5774147-4654-4ac3-add1-fec0c81ed2d8"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:31.821448 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:31.821920 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:31.822347 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:31.833990 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] Creating event network-changed:b5774147-4654-4ac3-add1-fec0c81ed2d8 for instance 91ddd878-836f-4de7-949f-d8005bda2dbb on hv-cinder-86188 Oct 19 13:56:31.839050 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-f0ef342a-d4eb-4c80-9048-4cedecedc553 req-bbb33d28-413e-4f65-b619-70d78251544c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Oct 19 13:56:31.839628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 665/1350] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:47.131532 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:47.184245 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:47.184741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:47.190677 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:47.191164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:47.191600 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:47.192283 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:47.192737 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:47.193166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:47.215663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-d91bf7aa-4adc-4ebd-b074-941f0629e731 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/ips" status: 200 len: 149 microversion: 2.1 time: 0.086104 Oct 19 13:57:47.216200 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 686/1351] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:57:47 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:49.855898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:49.856640 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=7 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:49.862377 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:49.864773 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:49.871369 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:49.878723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:49.878723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:49.878723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:49.878723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:49.879147 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:50.605779 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f08301cc-ffa6-48e3-9b0e-d1a524bdb0dd tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752021 Oct 19 13:57:50.606383 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 666/1352] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:57:49 2022] POST /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:58.136222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f"}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:58.138630 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:58.140760 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:58.141413 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=4 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:58.146274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.146791 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.147227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.147910 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.148365 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.148788 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.226675 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: POST /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments HTTP/1.1 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 74 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:57:58.228623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {"volumeAttachment": {"volumeId": "d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f"}} Oct 19 13:57:58.230271 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'server_id': '91ddd878-836f-4de7-949f-d8005bda2dbb', 'body': {'volumeAttachment': {'volumeId': 'd3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f'}}} Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:57:58.231306 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:58.232998 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 400 to user: Invalid volume: volume d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f is already attached to instances: 91ddd878-836f-4de7-949f-d8005bda2dbb {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e493c429-2007-403f-8901-a560698f6aed tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097871 Oct 19 13:57:58.235267 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 687/1353] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:57:58 2022] POST /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:57:58.296056 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:58.297299 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:58.303395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.303900 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.304306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.305017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.305472 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.305895 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.383559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'services' on Instance uuid 91ddd878-836f-4de7-949f-d8005bda2dbb {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:57:58.561069 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3fe147cf-d478-4d32-a9f1-f0cd64012374 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments/d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f" status: 202 len: 0 microversion: 2.1 time: 0.269591 Oct 19 13:57:58.561676 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 667/1354] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:57:58 2022] DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments/d3ffd8b2-2f33-468d-bf5c-a96b4d1bca4f => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:57:58.570027 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:58.572201 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:58.579337 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.579854 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.580314 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.581010 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:58.581491 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:58.581907 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:58.611425 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e2a21dd2-f8e6-4c9f-80e9-63ba2c196c06 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Oct 19 13:57:58.611974 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 688/1355] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:57:58 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:59.626075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:59.628357 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:59.634972 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:59.635487 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:59.640392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:59.640392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:59.640392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:59.640392 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:59.666269 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-56a38f52-8a77-4649-9cb0-b18742d0d9b0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Oct 19 13:57:59.669133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 668/1356] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:57:59 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:00.678896 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:00.681180 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:00.688099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:00.688583 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:00.689020 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:00.689711 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:00.690198 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:00.690670 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:00.719277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-9e340a06-8b8e-4260-981b-405afc698f0a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044417 Oct 19 13:58:00.719826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 689/1357] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:58:00 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:58:00.782045 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:00.782560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:00.789000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:00.789481 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:00.789916 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:00.790628 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:00.791084 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:00.791511 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:00.816467 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Going to try to terminate instance {{(pid=125749) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:58:01.110969 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-41c463d6-b83c-4776-83f5-6b64eb6feebf tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 204 len: 0 microversion: 2.1 time: 0.332423 Oct 19 13:58:01.111560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 669/1358] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:58:00 2022] DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:58:01.119564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:01.120174 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:01.126785 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:01.127259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:01.127689 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:01.128366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:01.128812 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:01.129229 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:01.258849 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:01.266568 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-493b8642-9893-40a2-8bca-c93a50881491 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1681 microversion: 2.1 time: 0.150747 Oct 19 13:58:01.267133 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 690/1359] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:01 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:02.292061 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:02.292720 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:02.299099 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:02.299579 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:02.300014 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:02.300694 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:02.301156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:02.301577 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:02.432951 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:02.441420 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-174c777c-092f-4b58-bc55-3c4a54e91d40 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1681 microversion: 2.1 time: 0.153684 Oct 19 13:58:02.441980 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 670/1360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:02 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:03.465210 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:03.465868 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:03.472713 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:03.473196 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:03.473629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:03.474316 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:03.474789 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:03.475212 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:03.604826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:03.613510 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-34939407-db47-4d28-8d68-f1fa66b42e72 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1681 microversion: 2.1 time: 0.152233 Oct 19 13:58:03.614085 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 691/1361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:03 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:03.990382 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ddd878-836f-4de7-949f-d8005bda2dbb", "name": "network-vif-deleted", "tag": "b5774147-4654-4ac3-add1-fec0c81ed2d8"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:04.004623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:04.005115 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:04.005553 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:04.020207 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] Creating event network-vif-deleted:b5774147-4654-4ac3-add1-fec0c81ed2d8 for instance 91ddd878-836f-4de7-949f-d8005bda2dbb on hv-cinder-86188 Oct 19 13:58:04.025096 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-2fb79bcf-45db-411a-a312-3899923b1c8b req-5dbb8911-61ba-43dd-aa87-1e9553f1c5ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038445 Oct 19 13:58:04.025744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 671/1362] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:04.636185 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:04.636792 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:04.643341 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:04.643825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:04.644252 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:04.645274 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:04.645629 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:04.646082 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:04.678084 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:04.678597 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:04.679074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:04.679525 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'fault' on Instance uuid 91ddd878-836f-4de7-949f-d8005bda2dbb {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:58:04.720696 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:04.728312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-5a22c802-0e94-4bba-8956-2fe02c5f50a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 200 len: 1331 microversion: 2.1 time: 0.096125 Oct 19 13:58:04.728874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 692/1363] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:04 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:05.753433 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:05.754133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:05.760259 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:05.760739 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:05.761170 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:05.761848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:05.762306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:05.762760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:05.776518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb HTTP/1.1 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 13:58:05.778100 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 13:58:05.779926 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '91ddd878-836f-4de7-949f-d8005bda2dbb'} Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:58:05.781025 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 13:58:05.782729 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 13:58:05.784507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:58:05.784507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-ea535653-e6ea-4489-acfd-91750f320272 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 404 len: 111 microversion: 2.1 time: 0.031276 Oct 19 13:58:05.784507 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 672/1364] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:05 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:58:05.788359 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8fc28246-ea33-4ae7-982a-7003426bcef7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '.version_select at 0x7fb41e39d310>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:05.861016 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8fc28246-ea33-4ae7-982a-7003426bcef7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571171769" status: 202 len: 0 microversion: 2.1 time: 0.076539 Oct 19 13:58:05.861575 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 693/1365] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571171769 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:58:06.582978 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-48e969f3-43e6-4660-9b6e-f53aaae39f07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: .version_select at 0x7fb41e755ca0>, body: {"keypair": {"name": "tempest-keypair-730472318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzkjdtNmCJI/3xIGlhQja4DnIe0SIu5ftRUgt6wpaxbfwltxX4ClDwD5GYdQYuYRTLI4aLQ44MioNICLEWScekhuDYZCugGZc255md6+h36+aoh6fZKdKIi4wH92g/UbA=="}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:06.598560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-48e969f3-43e6-4660-9b6e-f53aaae39f07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:58:06.602367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.quota [None req-48e969f3-43e6-4660-9b6e-f53aaae39f07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'key_pairs'} {{(pid=125749) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:58:06.678492 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-48e969f3-43e6-4660-9b6e-f53aaae39f07 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099370 Oct 19 13:58:06.679134 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 673/1366] 10.222.0.39 () {60 vars in 1159 bytes} [Wed Oct 19 13:58:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:58:08.742945 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1523681441", "imageRef": "d389753e-ade4-4ce8-b01b-c7f31b542c43", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f9c3265-aa51-43a0-aa8a-6d27e1b19059"}], "security_groups": [{"name": "tempest-securitygroup--948956823"}], "key_name": "tempest-keypair-730472318", "user_data": "}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:08.845063 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.network.neutron [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] validate_networks() for [('5f9c3265-aa51-43a0-aa8a-6d27e1b19059', None, None, None, None, None)] {{(pid=125748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:58:09.250580 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:58:09.251035 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image limits 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:58:09.252148 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Flavor pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:58:09.252587 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Image pref 0:0:0 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:58:09.252999 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.virt.hardware [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:58:09.261572 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:09.262044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:09.262470 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:09.263215 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:09.263684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:09.264103 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:09.281154 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:58:09.285050 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.quota [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Getting quotas for user c8e5d4efe11f4f198a9b028b69c23ee6 and project 86a09ef08cc44d4b98c86f0e430006f4. Resources: {'instances', 'cores', 'ram'} {{(pid=125748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:58:09.295687 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Going to run 1 instances... {{(pid=125748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:58:09.297926 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d389753e-ade4-4ce8-b01b-c7f31b542c43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:58:09.444825 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-24d3f0c0-095f-4799-9a3f-d7d82d4620a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.706733 Oct 19 13:58:09.445459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 694/1367] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Oct 19 13:58:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:58:09.457075 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-5ca0b6c5-5db8-4371-aede-a0bc08f8a8a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:09.457681 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-5ca0b6c5-5db8-4371-aede-a0bc08f8a8a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:09.513245 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-5ca0b6c5-5db8-4371-aede-a0bc08f8a8a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:09.523136 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-5ca0b6c5-5db8-4371-aede-a0bc08f8a8a7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1241 microversion: 2.1 time: 0.070462 Oct 19 13:58:09.523688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 674/1368] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:09 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:10.545591 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:10.546209 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:10.552259 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:10.552741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:10.553333 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:10.553838 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:10.554276 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:10.554730 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:10.614882 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:10.623058 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8d13f08c-e24e-48e7-bd09-e5ee487e8bd7 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1245 microversion: 2.1 time: 0.081712 Oct 19 13:58:10.623623 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 695/1369] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:10 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:11.647619 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:11.648240 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:11.654823 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:11.655307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:11.655744 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:11.656451 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:11.656898 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:11.657321 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:11.735088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:11.742967 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9f623402-1da8-4cf0-baef-d4e324ae577d tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1301 microversion: 2.1 time: 0.099503 Oct 19 13:58:11.743568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 675/1370] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:11 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:58:12.766560 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:12.767279 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:12.774155 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:12.774663 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:12.775099 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:12.775826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:12.776277 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:12.776699 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:12.906659 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:12.915397 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3f3e7d46-66c6-4ac0-963d-82cd55c146ef tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.152731 Oct 19 13:58:12.915976 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 696/1371] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:12 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:13.576107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c716efe5-48fb-40c0-b3f2-f8799ec79c7c", "tag": "d31a78e1-ff84-46ca-9fde-5584e68f4707"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:13.586811 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:13.587324 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:13.587760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:13.598669 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] Creating event network-changed:d31a78e1-ff84-46ca-9fde-5584e68f4707 for instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c on hv-cinder-86188 Oct 19 13:58:13.603437 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-10d1777d-a413-45a0-8a72-34d67f7818e8 req-252c1e4f-183d-40da-8a26-6f60369cbabd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031024 Oct 19 13:58:13.604060 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 676/1372] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:58:13.938717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:13.939933 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:13.946242 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:13.947502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:13.947502 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:13.947850 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:13.948300 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:13.948723 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:14.319744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:14.327529 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-82110c5a-614d-446d-ba0a-9208c09beb58 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.392752 Oct 19 13:58:14.328095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 697/1373] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:13 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:15.351293 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:15.351994 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:15.358066 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:15.358578 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:15.359017 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:15.359705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:15.360148 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:15.360570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:15.489518 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:15.497181 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-270b7c52-0250-4914-ab3a-16a82af2a2a9 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.150633 Oct 19 13:58:15.497737 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 677/1374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:15 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:16.520669 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:16.521281 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:16.527780 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:16.528258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:16.528691 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:16.529407 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:16.529858 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:16.530282 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:16.657693 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:16.665392 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-2382b52e-5878-4433-b29a-c5c4e4b3af33 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.149584 Oct 19 13:58:16.665947 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 698/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:16 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:17.688559 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:17.689633 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:17.696088 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:17.696566 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:17.697000 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:17.697683 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:17.698139 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:17.698584 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:17.824399 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:17.832523 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b1a281c8-6a97-4a7b-8fbd-97e4bca6d8ae tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.147813 Oct 19 13:58:17.833089 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 678/1376] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:17 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:18.854961 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:18.855571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:18.861940 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:18.862417 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:18.862874 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:18.863557 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:18.864033 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:18.864459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:18.996634 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:19.004408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-acb0d56d-9ba1-4f47-849a-7413cc18a3f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.153216 Oct 19 13:58:19.005315 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 699/1377] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:18 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:20.027186 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:20.027806 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:20.030172 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell0:SELECT=6 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.030862 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.036044 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.036526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.036960 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.037701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.038156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.038611 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.042524 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.169256 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:20.177582 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-293abeeb-8e47-4107-b705-c01b3757b43b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.154295 Oct 19 13:58:20.178142 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 679/1378] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:20 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:20.456520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=2 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.457270 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell0:SELECT=6 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.507724 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c716efe5-48fb-40c0-b3f2-f8799ec79c7c", "name": "network-vif-plugged", "status": "completed", "tag": "d31a78e1-ff84-46ca-9fde-5584e68f4707"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:20.517688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.518163 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.518621 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.529909 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] Creating event network-vif-plugged:d31a78e1-ff84-46ca-9fde-5584e68f4707 for instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c on hv-cinder-86188 Oct 19 13:58:20.535815 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-144a6c12-a7fb-4ec8-bf5c-eb6e21cd8bab req-effa5bbe-796d-451f-882b-47f48e194723 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084156 Oct 19 13:58:20.536595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 700/1379] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:21.199536 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:21.200076 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:21.207792 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:21.208273 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:21.208701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:21.209428 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:21.209879 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:21.210327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:21.334780 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:21.342258 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-3f638639-9688-4fb8-b141-e0ebb8a0034e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.146654 Oct 19 13:58:21.342848 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 680/1380] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:21 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:22.366256 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:22.366990 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:22.373779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:22.377136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:22.377136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:22.377136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:22.377136 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:22.377546 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:22.502342 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:22.509864 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-3ea650db-0d64-40cf-bdec-43b903cb677e tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1366 microversion: 2.1 time: 0.148837 Oct 19 13:58:22.510433 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 701/1381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:22 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:23.532646 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:23.533886 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:23.540367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:23.540855 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:23.541294 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:23.541984 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:23.542439 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:23.542896 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:23.671187 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:58:23.678798 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-d0f0bad5-fd83-4515-a612-41c77dc442da tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1556 microversion: 2.1 time: 0.149980 Oct 19 13:58:23.679362 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 681/1382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:58:23 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:58:23.701240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:23.701761 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:23.708766 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:23.709249 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:23.709684 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:23.710370 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:23.710884 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:23.711312 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:23.788783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-65ceb6cc-b4dc-46e5-b281-e3587124de6b tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087954 Oct 19 13:58:23.788783 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 702/1383] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Oct 19 13:58:23 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:24.724133 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c716efe5-48fb-40c0-b3f2-f8799ec79c7c", "tag": "d31a78e1-ff84-46ca-9fde-5584e68f4707"}]} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:24.734028 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:24.735568 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:24.736112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:24.747666 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.compute.server_external_events [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] Creating event network-changed:d31a78e1-ff84-46ca-9fde-5584e68f4707 for instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c on hv-cinder-86188 Oct 19 13:58:24.752597 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [req-bbfb2764-7060-4591-ab95-81f92d0ed66c req-e5791d3b-6485-4c2a-9f6e-14640029cb7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Oct 19 13:58:24.753395 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 682/1384] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:39.814412 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:39.815183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG dbcounter [-] [125748] Writing DB stats nova_cell1:SELECT=82 {{(pid=125748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:39.820040 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:39.820524 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:39.826636 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:39.831603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:39.831603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:39.831603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:39.831603 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:39.832087 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:39.852717 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-f3bf2857-611f-4998-9784-22d3120d23c5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/ips" status: 200 len: 149 microversion: 2.1 time: 0.040404 Oct 19 13:59:39.853258 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 703/1385] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 13:59:39 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:42.511350 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_api:SELECT=7 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:42.512090 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG dbcounter [-] [125749] Writing DB stats nova_cell1:SELECT=19 {{(pid=125749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:42.513308 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:59:42.513444 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Wed Oct 19 13:59:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments (ip 10.222.0.39) !!! Oct 19 13:59:42.518993 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c686931-d371-47ee-aeb9-3802c7a37886"}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:42.521370 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:42.528853 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:42.529327 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:42.529760 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:42.530438 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:42.530911 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:42.531328 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:43.222052 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-aab92f82-013b-450b-a906-42da491d38d8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "POST /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712441 Oct 19 13:59:43.222688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 683/1386] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Oct 19 13:59:42 2022] POST /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:50.846156 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:50.846664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:50.854564 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:50.855042 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:50.855471 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:50.856149 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:50.856595 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:50.857044 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:50.937097 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.objects.instance [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'services' on Instance uuid c716efe5-48fb-40c0-b3f2-f8799ec79c7c {{(pid=125748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:59:51.136827 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-78d4a940-d47a-43c9-b1a2-c5cd0e9d18d5 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments/7c686931-d371-47ee-aeb9-3802c7a37886" status: 202 len: 0 microversion: 2.1 time: 0.294347 Oct 19 13:59:51.137449 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 704/1387] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Oct 19 13:59:50 2022] DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments/7c686931-d371-47ee-aeb9-3802c7a37886 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:59:51.146996 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:51.149935 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:51.155956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:51.156436 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:51.156863 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:51.157551 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:51.158002 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:51.158424 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:51.190512 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-897a3cc6-ba5c-49b1-a221-7eb07035777a tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Oct 19 13:59:51.191081 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 684/1388] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:59:51 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:52.204582 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:52.206938 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:52.213127 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:52.213607 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:52.214046 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:52.214779 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:52.215222 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:52.215647 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:52.245372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-56614105-3347-4347-a793-945e6f497860 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Oct 19 13:59:52.245916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 705/1389] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:59:52 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:53.258367 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:53.260465 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:53.267246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.267723 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.268157 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.268833 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.269285 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.269706 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.297550 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-b1f0c81e-5a3c-4e8c-b2b2-d839608d3e57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043833 Oct 19 13:59:53.298091 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 685/1390] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Oct 19 13:59:53 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:59:53.359841 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:53.360332 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:53.367118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.367589 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.368014 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.368688 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.369130 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.369543 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.396911 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Going to try to terminate instance {{(pid=125748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:59:53.632497 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-c5b5af77-c388-4654-a5ee-6a21ec410219 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 204 len: 0 microversion: 2.1 time: 0.276140 Oct 19 13:59:53.633079 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 706/1391] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 13:59:53 2022] DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:59:53.641124 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:53.642027 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:53.647948 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.648435 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.649041 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.649790 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:53.650246 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:53.650710 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:53.780644 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:53.788952 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-6ff7b93b-d31d-4796-a9c7-874a6cf8fb42 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1680 microversion: 2.1 time: 0.151678 Oct 19 13:59:53.789510 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 686/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:53 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:54.813649 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:54.814382 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:54.821383 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:54.821860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:54.822293 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:54.823000 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:54.823483 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:54.823905 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:54.951901 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.policy [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:54.959605 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-099ff051-8e67-4a13-aa24-361c36232c00 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1680 microversion: 2.1 time: 0.150274 Oct 19 13:59:54.960166 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 707/1393] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:54 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:55.982800 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:55.983352 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:55.989722 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:55.990206 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:55.990671 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:55.991953 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:55.992410 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:55.992834 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:56.187266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:56.190358 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-327a884b-ef64-4489-82f3-07a67215669c tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1680 microversion: 2.1 time: 0.211617 Oct 19 13:59:56.191008 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 687/1394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:55 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:56.597278 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c716efe5-48fb-40c0-b3f2-f8799ec79c7c", "name": "network-vif-deleted", "tag": "d31a78e1-ff84-46ca-9fde-5584e68f4707"}]} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:56.607941 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:56.608424 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:56.608856 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:56.621824 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.compute.server_external_events [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] Creating event network-vif-deleted:d31a78e1-ff84-46ca-9fde-5584e68f4707 for instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c on hv-cinder-86188 Oct 19 13:59:56.626814 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [req-04a90b97-813c-400a-abd4-966df8d56d16 req-0742f376-5af1-4837-a366-c52758c463f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033234 Oct 19 13:59:56.627653 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 708/1395] 10.222.0.39 () {64 vars in 1317 bytes} [Wed Oct 19 13:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:57.213746 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:57.214359 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:57.220664 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:57.221145 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:57.221581 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:57.222290 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:57.222750 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:57.223180 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:57.256512 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:57.257484 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:57.257946 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:57.258385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.objects.instance [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lazy-loading 'fault' on Instance uuid c716efe5-48fb-40c0-b3f2-f8799ec79c7c {{(pid=125749) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:59:57.299122 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.policy [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5d4efe11f4f198a9b028b69c23ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a09ef08cc44d4b98c86f0e430006f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125749) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:57.307143 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-750d4c2c-8dd4-44fe-9314-7a204af96f57 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 200 len: 1331 microversion: 2.1 time: 0.097775 Oct 19 13:59:57.307713 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 688/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:57 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:58.337506 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:58.338205 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:58.344454 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:58.344932 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:58.345366 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:58.346056 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:58.346530 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:58.346985 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:58.360799 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c HTTP/1.1 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 13:59:58.362441 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 13:59:58.364297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'c716efe5-48fb-40c0-b3f2-f8799ec79c7c'} Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:59:58.365512 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 13:59:58.367372 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 13:59:58.368867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:59:58.368867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-a78286df-3d23-456d-b6f2-652a8df657f0 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 404 len: 111 microversion: 2.1 time: 0.031636 Oct 19 13:59:58.368867 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 709/1397] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:58 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:59:58.372517 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-c2eb57cf-03e9-4f1d-88d9-f81fe173c5e8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '.version_select at 0x7fb421ce1dc0>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:58.446712 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-c2eb57cf-03e9-4f1d-88d9-f81fe173c5e8 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730472318" status: 202 len: 0 microversion: 2.1 time: 0.077891 Oct 19 13:59:58.447267 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 689/1398] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Oct 19 13:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730472318 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 14:00:00.510164 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:00.510758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:00.517380 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:00.517860 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:00.518297 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:00.519017 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:00.519466 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:00.519886 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:00.533404 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c HTTP/1.1 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:00.534946 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.536826 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'c716efe5-48fb-40c0-b3f2-f8799ec79c7c'} Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:00.537881 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.540227 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.541934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:00.541934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1402d788-af9b-499a-a0dd-3b6d41a2e1be tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 404 len: 111 microversion: 2.1 time: 0.029932 Oct 19 14:00:00.541934 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 710/1399] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 14:00:00 2022] DELETE /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:00.545647 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:00.546261 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: c716efe5-48fb-40c0-b3f2-f8799ec79c7c] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:00.552785 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:00.553264 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:00.553701 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:00.554385 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:00.554885 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:00.555314 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:00.567930 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c HTTP/1.1 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:00.569537 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.571248 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'c716efe5-48fb-40c0-b3f2-f8799ec79c7c'} Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:00.572120 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. Oct 19 14:00:00.573503 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:00.574838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance c716efe5-48fb-40c0-b3f2-f8799ec79c7c could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:00.574838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-baa3d5a4-e560-4a1d-b1d1-8e18a5babac1 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c" status: 404 len: 111 microversion: 2.1 time: 0.029498 Oct 19 14:00:00.574838 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 690/1400] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 14:00:00 2022] GET /compute/v2.1/servers/c716efe5-48fb-40c0-b3f2-f8799ec79c7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:01.827697 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:01.828203 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:01.834749 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.835234 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.835671 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.836357 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.836809 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.837236 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.851129 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb HTTP/1.1 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:01.852644 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.854408 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '91ddd878-836f-4de7-949f-d8005bda2dbb'} Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:01.855299 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.856664 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.858362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:01.858362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-8f92a3dc-5037-4d4a-ad88-e990c36300a4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 404 len: 111 microversion: 2.1 time: 0.030118 Oct 19 14:00:01.858362 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 711/1401] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 14:00:01 2022] DELETE /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:01.862141 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:01.862784 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 91ddd878-836f-4de7-949f-d8005bda2dbb] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:01.869104 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.869580 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.870049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.870757 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.871218 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.871642 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.884527 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb HTTP/1.1 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:01.886623 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.888307 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '91ddd878-836f-4de7-949f-d8005bda2dbb'} Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:01.889320 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. Oct 19 14:00:01.890955 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.892656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 91ddd878-836f-4de7-949f-d8005bda2dbb could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:01.892656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-15e51674-60e4-4ca4-8e5a-72103dd07dba tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb" status: 404 len: 111 microversion: 2.1 time: 0.029612 Oct 19 14:00:01.892656 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 691/1402] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 14:00:01 2022] GET /compute/v2.1/servers/91ddd878-836f-4de7-949f-d8005bda2dbb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 14:00:01.896302 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:01.896801 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:01.903253 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.903758 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.904193 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.904872 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.905322 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.905741 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.918818 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f HTTP/1.1 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:01.920354 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.922118 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'f23264d0-26c1-48f3-830a-d2d480f0480f'} Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:01.923240 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.924916 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.926594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:01.926594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-1b1293c6-f549-4b58-8700-af63a8f1d0f3 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 404 len: 111 microversion: 2.1 time: 0.029079 Oct 19 14:00:01.926594 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 712/1403] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 14:00:01 2022] DELETE /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:01.930032 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:01.930697 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: f23264d0-26c1-48f3-830a-d2d480f0480f] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:01.936629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.937107 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.937539 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.938211 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:01.938688 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:01.939113 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:01.952563 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f HTTP/1.1 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:01.954158 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.955989 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'f23264d0-26c1-48f3-830a-d2d480f0480f'} Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:01.956968 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. Oct 19 14:00:01.958570 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:01.960112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance f23264d0-26c1-48f3-830a-d2d480f0480f could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:01.960112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f3489626-2c6c-4718-a613-9d27932e4b6f tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f" status: 404 len: 111 microversion: 2.1 time: 0.029488 Oct 19 14:00:01.960112 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 692/1404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 14:00:01 2022] GET /compute/v2.1/servers/f23264d0-26c1-48f3-830a-d2d480f0480f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:03.211652 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:03.212147 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.compute.api [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:03.219171 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:03.219643 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:03.220074 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:03.220776 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:03.221225 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:03.221638 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG oslo_concurrency.lockutils [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:03.234744 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 HTTP/1.1 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:03.236265 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: > Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.238009 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': '6f33c077-46ba-4d09-96f4-5af851f1bd97'} Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:03.239064 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.240700 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.242736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:03.242736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-89eab2ed-4708-4824-8106-6e4724b88da4 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 404 len: 111 microversion: 2.1 time: 0.029860 Oct 19 14:00:03.242736 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 713/1405] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Oct 19 14:00:03 2022] DELETE /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:03.246046 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Calling method '>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:03.246685 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.compute.api [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] [instance: 6f33c077-46ba-4d09-96f4-5af851f1bd97] Fetching instance by UUID {{(pid=125749) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:00:03.253049 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:03.253526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:03.253956 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:03.254684 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Acquiring lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:00:03.255190 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:00:03.255560 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG oslo_concurrency.lockutils [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Lock "3b9b7359-86fa-48bf-ad7a-7001c78b7560" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125749) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:00:03.269787 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] HTTP exception thrown: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Request method failure captured: Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 HTTP/1.1 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUAEdZkzcxHCCA4sq8VgbFoRILYaKF0a5tpn9pulbsW5vA7CHIWUkQt8sBUZRucN2bHhmKlfIinw8aG-FXjp9P00kbjB9FlxuVh17WZAdt4oPEl-kY_qfE0r1IyaGq-76yMmxuPI0e-CFPdGJ1Mh2QXLD8VazAI8PTqK7pMUBhCKMbS4 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:03.271323 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_86a09ef08cc44d4b98c86f0e430006f4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/86a09ef08cc44d4b98c86f0e430006f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 86a09ef08cc44d4b98c86f0e430006f4 Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-918248714 Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: c8e5d4efe11f4f198a9b028b69c23ee6 Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-AttachVolumeNegativeTest-918248714-project Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: > Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.273266 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': '6f33c077-46ba-4d09-96f4-5af851f1bd97'} Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:03.274337 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. Oct 19 14:00:03.276605 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:03.278184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] Returning 404 to user: Instance 6f33c077-46ba-4d09-96f4-5af851f1bd97 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:03.278184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-fa1fa515-98d6-4a23-855f-0a5200618fb2 tempest-AttachVolumeNegativeTest-918248714 tempest-AttachVolumeNegativeTest-918248714-project] 10.222.0.39 "GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97" status: 404 len: 111 microversion: 2.1 time: 0.030532 Oct 19 14:00:03.278184 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 693/1406] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Oct 19 14:00:03 2022] GET /compute/v2.1/servers/6f33c077-46ba-4d09-96f4-5af851f1bd97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:08.627548 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb520c41-ff1a-453f-8dd4-9c4bd109c1fb tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Action: 'create', calling method: .version_select at 0x7fb41e426820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-117562032", "metadata": {"Type": "work"}}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb520c41-ff1a-453f-8dd4-9c4bd109c1fb tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 121 Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:08.637657 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-117562032", "metadata": {"Type": "work"}}} Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: Oct 19 14:00:08.639459 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-117562032', 'metadata': {'Type': 'work'}}}} Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise error Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.640567 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 14:00:08.643183 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 14:00:08.644832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 14:00:08.644832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.644832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-fb520c41-ff1a-453f-8dd4-9c4bd109c1fb tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.644832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-fb520c41-ff1a-453f-8dd4-9c4bd109c1fb tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122057 Oct 19 14:00:08.644832 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 714/1407] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 14:00:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 14:00:08.648867 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dd7d0798-625a-4c5b-acdf-e3d945172eb2 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Action: 'create', calling method: .version_select at 0x7fb421d31790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-507063766", "metadata": {"Type": "work"}}} {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dd7d0798-625a-4c5b-acdf-e3d945172eb2 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 119 Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:08.653380 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-507063766", "metadata": {"Type": "work"}}} Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 14:00:08.655156 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-507063766', 'metadata': {'Type': 'work'}}}} Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise error Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi '0' Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.656161 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 14:00:08.657976 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 14:00:08.659531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 14:00:08.659531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.659531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-dd7d0798-625a-4c5b-acdf-e3d945172eb2 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.659531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-dd7d0798-625a-4c5b-acdf-e3d945172eb2 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009778 Oct 19 14:00:08.659531 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 694/1408] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 14:00:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 14:00:08.663765 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e67f3ac0-d346-4d16-8476-91457ef8ce44 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Action: 'create', calling method: .version_select at 0x7fb41e2e8dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1957204688", "metadata": {"Type": "work"}}} {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e67f3ac0-d346-4d16-8476-91457ef8ce44 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 119 Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:08.668751 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1957204688", "metadata": {"Type": "work"}}} Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: Oct 19 14:00:08.670485 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1957204688', 'metadata': {'Type': 'work'}}}} Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise error Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi '' Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.671513 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 14:00:08.673286 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 14:00:08.675095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 14:00:08.675095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.675095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e67f3ac0-d346-4d16-8476-91457ef8ce44 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.675095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e67f3ac0-d346-4d16-8476-91457ef8ce44 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010072 Oct 19 14:00:08.675095 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 715/1409] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Oct 19 14:00:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 14:00:08.679705 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f2505a39-b449-4b03-b7b4-a2fdb5a2f6de tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Calling method '.version_select at 0x7fb421d15040>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:08.710306 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-f2505a39-b449-4b03-b7b4-a2fdb5a2f6de tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] HTTP exception thrown: Volume tempest-invalid-701937635 could not be found. Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f2505a39-b449-4b03-b7b4-a2fdb5a2f6de tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-701937635 HTTP/1.1 Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:08.712330 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Volume tempest-invalid-701937635 could not be found. Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'tempest-invalid-701937635'} Oct 19 14:00:08.715526 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-701937635 could not be found. (HTTP 404) (Request-ID: req-efda6c35-adb2-492d-bc14-0b006aa49d19) Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.716604 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 14:00:08.718408 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-701937635 could not be found. Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:08.720026 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-701937635 could not be found. Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-701937635 could not be found. Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-f2505a39-b449-4b03-b7b4-a2fdb5a2f6de tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 404 to user: Volume tempest-invalid-701937635 could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-f2505a39-b449-4b03-b7b4-a2fdb5a2f6de tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-701937635" status: 404 len: 98 microversion: 2.1 time: 0.038227 Oct 19 14:00:08.721691 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 695/1410] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Oct 19 14:00:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-701937635 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 14:00:08.723377 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-92a01840-3298-4658-8fbc-2d4082e509d2 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003852 Oct 19 14:00:08.723870 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 716/1411] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Oct 19 14:00:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 14:00:08.732574 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-373cba90-b3c1-48f3-82c9-6565fd97fc7c tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004192 Oct 19 14:00:08.736754 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 696/1412] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Oct 19 14:00:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 14:00:08.743831 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e1a59d11-4c1e-4e82-8b93-97b6ba0a34f4 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Calling method '.version_select at 0x7fb41e4ac790>' {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:08.774135 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.wsgi [None req-e1a59d11-4c1e-4e82-8b93-97b6ba0a34f4 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] HTTP exception thrown: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e1a59d11-4c1e-4e82-8b93-97b6ba0a34f4 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: request: DELETE /compute/v2.1/os-volumes/fe961303-6dcf-4338-819a-6c812c66c58e HTTP/1.1 Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept: application/json Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Accept-Encoding: identity Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Connection: close Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Length: 0 Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Content-Type: application/json Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Host: 10.222.0.39 Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: Openstack-System-Scope: None Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Id: None Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Domain-Name: None Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Identity-Status: Confirmed Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Is-Admin-Project: True Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Id: default Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Domain-Name: Default Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Role: member,reader Oct 19 14:00:08.776571 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Roles: member,reader Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Id: default Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Domain-Name: Default Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: method: Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: exception: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: action_args: {'id': 'fe961303-6dcf-4338-819a-6c812c66c58e'} Oct 19 14:00:08.778520 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: {{(pid=125748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. (HTTP 404) (Request-ID: req-7eb25f06-ef13-4812-8de4-21972634b7a1) Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.779747 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 14:00:08.781440 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 14:00:08.783105 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: DEBUG nova.api.openstack.wsgi [None req-e1a59d11-4c1e-4e82-8b93-97b6ba0a34f4 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 404 to user: Volume fe961303-6dcf-4338-819a-6c812c66c58e could not be found. {{(pid=125748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: INFO nova.api.openstack.requestlog [None req-e1a59d11-4c1e-4e82-8b93-97b6ba0a34f4 tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/fe961303-6dcf-4338-819a-6c812c66c58e" status: 404 len: 109 microversion: 2.1 time: 0.037697 Oct 19 14:00:08.784654 dv-cinder-861883-1-iscsi devstack@n-api.service[125748]: [pid: 125748|app: 0|req: 717/1413] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Oct 19 14:00:08 2022] DELETE /compute/v2.1/os-volumes/fe961303-6dcf-4338-819a-6c812c66c58e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:00:08.787499 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9f3ff3a0-ac02-4420-a1bf-68da8574355b tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Calling method '.version_select at 0x7fb41e254f70>' {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:00:08.814814 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.wsgi [None req-9f3ff3a0-ac02-4420-a1bf-68da8574355b tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] HTTP exception thrown: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9f3ff3a0-ac02-4420-a1bf-68da8574355b tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Request method failure captured: Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: request: GET /compute/v2.1/os-volumes/ab107506-90e2-4a7f-a3d4-7a30b9ad19ff HTTP/1.1 Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept: application/json Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Accept-Encoding: identity Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Connection: close Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Length: 0 Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Content-Type: application/json Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Host: 10.222.0.39 Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: Openstack-System-Scope: None Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: User-Agent: python-urllib3/1.26.12 Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Auth-Token: gAAAAABjUALo_PgzHaFr04vAzYEymVYYHYe7YIss1M-Ro7cRztQbGxVLuclCl4Ssx74szRLAB0-Uznf-iMj0J2_M_XVv1KmwwSq5-DP3RTfmR8q0ZTpgH3n22wwmf7Pz_DDnY9MsY5nqgdxaCPTj7wlKzA4BL2c8CvWG07DK_G98DfGS-io1kIY Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Id: None Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Domain-Name: None Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Identity-Status: Confirmed Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Is-Admin-Project: True Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Id: default Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Domain-Name: Default Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Project-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Role: member,reader Oct 19 14:00:08.816762 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Roles: member,reader Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a091bde8060401195865593b082202e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a091bde8060401195865593b082202e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a091bde8060401195865593b082202e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Id: 7a091bde8060401195865593b082202e Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-Tenant-Name: tempest-VolumesNegativeTest-1398183420 Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Id: default Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Domain-Name: Default Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Id: 0754531faf8c45d2b1b81a7ba7e211fe Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: X-User-Name: tempest-VolumesNegativeTest-1398183420-project Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: method: Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: exception: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: action_args: {'id': 'ab107506-90e2-4a7f-a3d4-7a30b9ad19ff'} Oct 19 14:00:08.818495 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: {{(pid=125749) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. (HTTP 404) (Request-ID: req-52a6f394-60ee-44a0-b214-cb023cfc19ef) Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.819629 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 14:00:08.821179 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 14:00:08.822682 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: ERROR nova.api.openstack.wsgi Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: DEBUG nova.api.openstack.wsgi [None req-9f3ff3a0-ac02-4420-a1bf-68da8574355b tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] Returning 404 to user: Volume ab107506-90e2-4a7f-a3d4-7a30b9ad19ff could not be found. {{(pid=125749) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: INFO nova.api.openstack.requestlog [None req-9f3ff3a0-ac02-4420-a1bf-68da8574355b tempest-VolumesNegativeTest-1398183420 tempest-VolumesNegativeTest-1398183420-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/ab107506-90e2-4a7f-a3d4-7a30b9ad19ff" status: 404 len: 109 microversion: 2.1 time: 0.034410 Oct 19 14:00:08.824233 dv-cinder-861883-1-iscsi devstack@n-api.service[125749]: [pid: 125749|app: 0|req: 697/1414] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Oct 19 14:00:08 2022] GET /compute/v2.1/os-volumes/ab107506-90e2-4a7f-a3d4-7a30b9ad19ff => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)